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ABSTRACT 

This volume^ contains ' one paper defining the initial 
operatingAparameters of the Research and Developsent Exchange (RDx) 
and four'^or a series of papers contracted for the program. The • 
overview paper touches on a variety of topics of continuing concern: 
the general problems toward which the RDx effort is directed^ 
understandings affecting the design of the work, specific problems 
being addressed by fhe BDx goals and objectives, prinqiples guiding 
the «ork, and examples c£ current activities. The first of the 
contracted papers presents a marketing 'approach to developing and 
diss^mixiating educational product?^ The second paper argues that 
maximum impact and utility of the RDx effort can te achievecl only if 
there is a* balance* between the needs and' interests of«potential 
clients on one hand and the services provided by. RDx on. the ether. 
'The third paper discusses k^nowledge pro^ducticn and utilization 
models, concentrating on understanding how they are affected by who. 
creates them and what assumptions are made, and discusses BDx f rom ^ 
the standpoint of the most bomprehensinre models. -It also makes 
recommendations based on this analysis. The last contract,.^-ptkPer 
discusses interorganization- relations problems in the dei^gnjand^ 
implementation of the RDx program. (Author/IRT) X - V v 

♦ Reproductions supplied by EDRS are the best that can be made 

♦ from the original document. ^ ♦ 
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INTRODUCTION ? ' " - >..f 



In an effort to, impt^ve research, development, and dis^emihation of edy&a^ 
tional ^products, the National Institute of Education (NIE) appears to have \ * 
adopted a change agent philosophy. Discussion3 to 4ate seejn to concentrate on 
providing more contact between users and change agents, on ephancing initial ^ 
acceptance, and on fostering contact between users, as a basis for facilitating \ 
natural diffusion. Moreover, there appears to be an emerging consensus that , 
what is necessary to make the change agent a^ivocacy approach work is to provide 
better mech^ni$ms to facilitate user evaluation of products'v Along these^lines, 
future change agent efforts ^ould emphasizowuser meetings and check li^ts ,and 

other ^na-teriale^ which users coijld measure products against.' 

. ' ' ' ' ) 

From a marketing. perspect;iye these- attempts to shore' up] the change agent 
advocacy approach do not s^emdikely to yield any great improvement. They are 
still basically an attempt to put the responsibility for educational products on 
the, user systefa- But the problem is not user sophistication pw, linkages. The . 

^ ^> >^'' " 

problem is that educational product^ are not, K^spons^-ve tb^Aiser need^. The 
solution is to embed the R&D process in marketing^ designed' organization which 
pursues a market;Lng philosophy. ■ 

It is appropriate, to consider a marketing approach to educational exchange, 

- ■ 'v ^ • \ ' i / 

because marketing entails perf orinii^ig. tho^e lactiviti-es which facilitate the ex- 
' change process. More specif ic ally, mar ke ting activities revolve around iden- 
tifying marketing opportunities and coordinating the lilatketing instruments 
under the njana^er's control to convert opportunities into product implementation 
Ey petforming" these,activitifekS. JLn a systen^tic way, the likelihood of achieving 
the goals' of the various part ies "in^oi^tf, in the educational exchange process 



as greatly, increased; product ushers are provided the means to improv^Jthe 

' V > \ • ' * 

V quality ipf their teaching, and product developers recoup- their investment 

whether this return is measured in dollars, satisfaction, the efficacy of the' 
educational experience, ,or some other criterion^ / " ■ 

'Pie purpose of this paper is to presen^t a marketing at>i^oach to* developing ♦ 
and disseminating educational products. To this end, the report is dii/ided into ., 
three sections, to Part I alternative approaches to facilitating the exchange 
process are examined. Emerging from this discussion is the thesis that it is 
now appropriate for educational exchange systems to adopt the marketing concept . 
Part II identifies the tasks or activities that must be performed iti ord^r to ^ 
operationalize marketing functions. For each activity identified, a detailed, 
discussion of how it may be accomplished is presented. ^n Part III, the 
organizational structures that may be developed, to facilitate, the performance 
of marketing activities are identifiecf? . 

^ I. Alternative Views of the Exchange ^Process. V . 

A variety of different philosophlles may be employed to ^ui<^e the development 

rot educational^ ^change systems. In this section; we shall characterize the 

. ' ' 3 ^ ■ ^ " 

irketing approach to educational exchange and identify those features which 

distinguish Ut from thfe approach currently being pursued by the National Institute, 
f - 

of Education. First, differences between th^ matketing appr^ch and other * 
philosophies of exchange are discussed. This entails ddentifying distinguishing 
characteristics of different exchange philo^Pphies- and demonstrating the rela- 
tive effectiveness of these' approaches in facilitating exchange." On the basis' • 
of this analysis, tfhe activities which are essential to effective educational 
excliange are identifie4. ■ . . 

Approaches to the Exchange Process " ' ^ x . ^ ♦ . 

Production . There arc several approaches or philosop*hies available to^ 



facilitate the exchange' process.' One entails adopting a production orientation. 
' When a production orientation is adopted, substantial R&D expenditures are 
aUoc^ted'to producing "a better mqusetrap." -This orientation usually ;:esults 
in the availability of a wide range. of products. A production philosophy 
guided the marketing efforts of the' Off icil of Education during the l^SO's and 
: 'l960's. Consistent With t^his orientation, resources.were allocated primarily 
• to research and development as opposed to product dissemination activities. 
'%/4he ander lying assumption was that the production of hew educational products 
that were superior -to existing, ones' would essentially sell ^themselves. 

• .Sates . Vhen the failure to gain widespread new product acceptance and 
utilization indicated that theT^e was little merit .in the production philosophy, 
; a sales orientation was adopted.* With. the establishment of NIE, focur. centered 
'not only on 'developing new educati^lff products, but also insuring ^heir dfs- 
semination by requiring that su^stantial resources bfe allocated to this task-. 
The ho^e wks -that a strong advocacy by various laboratories centers and Title III 
demonstration centers would enhance new. product adoption arfd implementation. 
This hope failed to materialize. Indeed the rate o.f acceptance of new educational 
.^products when the sales oril^ntation wAs employed was not appreciably different 
• thaV th^t experienced when the production orientation had been the'dominant philo- 
sophy of marketing. ^ 

rhnnf. . Aeent Advocacy . In large measure, the failure of the sales orienta- 
tion was attributed to the inappropriateness of advocacy by producers and ot{.cr ^ 
' Sellers in an educational context.' A consensus developed that the role, of dis^ 

semination could not be^to advocate products, many of which might be of Icu. qualitj 
• It made more sense to present users with information about products and to 
demonstrate the products, but not to advocate the products explicitly. The re- 
sponsibility ^for actually choosing a product wa^J placed on the user. The change 

I C - ' 8 ' . 



- 4 - ' 

- \ . ... ' 

agent advocacy phllosVphy seems (to have provided a convenlonC rationale for 
this approach. It provides justjlf ication that the role of dissemination should 
be to make products accessi^^i^to those who. are most disposed to adopting them,. 
The final adoption level should be" left up to the user system itself. 

. The adoption of a change agent advocacy appr&ach in marketing education 
R&D products essentially meant providing tools to users. No attempt is made 
to directly effect educational improvements; rather the strategy is to ma^e ' r . 
available tools which, if accepted, will themselves foster change. The tool is • , 
what is important, not the user. This approach in its most basic form is the 
agricultural extension model.. In this model, R&D efforts result in miracle ~ ^^^^ — , 
products which are truly "innovations" or at least are clearly superior to ' 
existing products. The problem for dissemination is to get these products, whioh 
by definition are "different" from what^ peop^le are used to, accepted* The^ ex- 
tension model assumes that users are ignorant with respect to the product, and 
perhaps in a more general sense ^ well, and that they have an inherent bias 
against change. The solution establish d^.rect persbnal contact .with the 

user. Initially this contact shoul'd be with users who^re most; receptive to 
change. The purpose of this contact is to create acceptance^ by demonstrating 
to the individual that the product yields clear benietSits for him or her. Ilie focus^of 
the extension model is thus qn showing the individual that the tool works. 

lygffilft^'^repTCd^^^s'ome^nu peopl^ who are usually 



thouglit to be elite, it should, according to the extension model, diffuse through 

the social syS'tem^.to othejr people. The early adopters should be influential 

- ^ * 

enough to create acceptance by other people in much the same "way that their, 
acteptance was created by the agent. The agent needs only to reinforce this 
pr6cess ^y making ^sure that the product and l^pVant infbrmation are available. 
The dominant iorce for ch«nnge arises through the natural ^interaction of people.^ 
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Ihe agents are onLy a'catalyst in the process. Ihey do not produce change. They 

• \ 

introduce, the conditions for change. • \ 

The change agen^hilosophy which has elolved i(( education, of course," go6s 
beyond the basic agricultural extension model. But the assumption^' remain much' 
the same; Change agent advocacy in education holds that users should be offered 
a wide variety of R&D products. There should be no explicit advocacy of these 
products. The advocacy should rather be implicit. Information about products , 
should be flUde available, and. if possible, the product should be demonstrated 
to ^otne users (hence the heavy influence of demonstration projects). Once this 
is accomplished. o»;her us^rs will be convinced that the products are useful and 
will be able to select' those which are best suited for them. ^' ^ 

- • Adoption of the product^ should proceed according to the p^^c, extension 
tDodel pattern for innovations: The early adopters are those who are most know- 
ledgeable or receptive and 'for whom the product is best suited.- These individtTal 

pass on their positive experience dirett'ly to other potential users, thereby . 

influencing others to, adopt the product as well. ,There is a snowballing effect 

in which the evaluations of early adapters ^nd their .communicative behavior play 
key role. 

The evidence available to date appears to, question the efficacy of the' 
change agent advocacy approach in educational settings. Indeed, a recent evalua- 
tion study by. the Office Education. Project LONGSTEP, documents the absence 
, of any^clear impact from educational5"ihnovations." .The study covered about « 
30.000 students In gr-ldes one through twelve. The students were drawn from 
thirteen diverse school districts in nine states.. A longitudinal design was 
employed; phe students were studied over a four-year period. The products 
■ covered included team teaching, teacher development materials, multimedia, flcxi 
UliXy in classroom structure, and individualized ingSructioti'. The study , con- 



auded that student growth was not correUted with adoption by the user system " 
of ^hese "innovative:;^|dXicts; If anVthing. the evidence "seemed to' indicate 
-that an emphasis on such products might be asSociatefl with moderate .rjt her than 
high student development. ' • 

_ From -our perspective, evidence such as this points to a clear breakdoim 
In the applicability of the agricultural extension model's assumptio^s\o' educa- ' 

V « * 

tion. Few, if any, products of educational R&D have a dramatic impact, *],et ' " 

alone an impact that will ba clearly' visibie and beneficial tp the immediate* 

-user. Therefore, there is no reason to b'elieve that merely exposing users t,o * 

these products, that is, making the products accessible, will lead to acceptance^ 

even by so-called innovators, simply on the basis of the demonstrable superiority 

of the products. And without this initial acceptance there is certainly no 

reason to expect the products to diffuse.through the uSeF^system. 

- V 

^Attempting to put the responsibility for acceptance of products on the ' ' 
user system may help contain criticism of educational R&D. It is not likely • 
to yield higher usage rates or, ^.itself, usir satisfaction. ;:his Is because ' 
the change ageht philosophy,- as it has^olved in education, fails to consider 
the needs of jyoduct users as 'dhe. impetus for R&D activity. Rattier," it ^relies ' 
on the assumption that superior products will emerfee spontaneously -- an assump- 
'tion that is yet to be borne out. ^ 

Marketing . A more compelling approach to^the dissemination of educational 

products entails adopting the marketing concept. The njarketing concept is nSt - 

so much incompatible with tffe change agent advocacy appcoaqh as it isa step * 

beyond it. Ti.e marketing concept recognizes the importance of product fe.iLuros, 

of .«arly users of a product, and" of the growth curve, life cycle diffusion of 
/ •• . . 

a product. But such considerations are not the prima movers in designing a 

marketing system. Tfie -prime mover is the needs of the user. Once a systematic ' 
approach- has been established to identify ■ user necis and to tran?late these needs 
into educationay-^roducts", it becomes appropriate to 'consider the, efficacy of a 
change agpnt advocacy, ll ' 



Marketing takes the "tocus of£. the prod'utt and puts it" on the user's- needs, 
g^roducts. are 'developed from the. user's point of view, not the -Rrodu«r ' s. ^ T-here 
is certainly room/or creative idea's and innovations in^the marketing sysTem. . 
The>user'* n^ed for a product may ^only b^e latent. Ihe. user may not be 'able to 
ev;n conceive -of the produc't muc'h.less express a desire for it. Even in the , ; 
case of latent-needs, however, beyond the initial stage of invention,^ 'the RSD . . 
process must.be guided by .user -consideration's. A product may ori^ihate in 
completely basic research ," but from initial idea onward it is developed with the . 
user in mind. ,less original prpducts are .e-j^pected' to develop-directly from-, 
useY^needs.,; The ^"iding principle of^^arkVing organiza^^ '''",_^^.V!L'.'~, . - 

vitles flow from the consumet. The system ^s user driven. * - ^ 

It might be argued that a change agent system is alSto user driven. Tl^is^ . 
is true o-nly in the 'sense that the user is making the fiVl evaluation and . 
decision.^ TKe -product ^till being directed at the user. . Perhap^^the .' . 
prodtict is being' directed less' forc^ef ully tfikn with other .verslotfs of the . ' 
6ai«^ concept-, but it U bei^g directed nonetheless from the^roducer '« ^ 
view/' The marl^etihg system is user driven in the sense t.V^^t U, is 
>e^er'%. needs-, latent or maA^est, that; providOhe direction^^ " ^ 

It is not sufficient merely^o" ad^^^a^^^dlat^ products^. 

available and then ^xpecrtiTe "u'^er^^^"^ able t^. ef fect change by r . - • . 

Sifting .through and evaluating th"! large variety' of products made available. ' 
' There is no. evidence that users have thi^ capability-.. It is not part of. • . 
their 'jobs; th^ h-ave^~ hot. been trained to -review, R&D products; they have ^ 
probibly grown skeptical ^of the educational R&D establishment.. While the 
change agent , advocacy v{ew of tl^e user may make sense for a. miracle' product , 
..given .the types of educational R&D pro'dJctS which are tn fact .turned^ogt, it ^ 
• -is quite doubtful that the typical user reacts .i^ anything likothc way he or she 
' •■ ' ■ ' ' \ ■ ' ' ' ■ ' ' 



the 



is pottrayed. The user almost certainly ^does not act in such a way as to 
. guide the entire R&D system by his evaluations. ' \ / ' 'x 

■On the other hand, there are strong signs that 'lisbrs do have definite, 
needs that could be satJrfied by the' R&D system. Existing products do not 
seem to be strbngly linked to these nedds. A good' example indicating the 
existence of unfilled needs is the publication of "ZeViyros," a non-profit ' 
West Coast magazine that has peirhaps reached almost SO.OpO teachers at 
$2.50 per issiie. The magazine is based on ideas that teachers 

send in which they have developed for use in' their classroom. The material 
may be In the form of letters, drawings, or mimeographed sheets, it u pasted 
together and printed as a' catalog. ' Apparently, many teachers find the material 
useful. This is not surprising! if a need exists for one teacher, it is 
likely that a similar need exists for another. That such a simple catalog 
could be successful, however, in the face of the competing volume of. ' 
professional R&D products, .stjongly suggests that the R&D prodticts are not' 
as sensitive to the user's needs as they might be. ' Although there appears 
to be little research which would_^llow us to be specific about what these ' 
needs are, this is just one example of the anecdotal evidence that 'unmet 
needs do exist. 

The existence of unfilled needs does not imply that the user will be re- . 
sponsive to change agent ^advocacy. . The user is oriented to the school system, 
the school, and the classroom, not to the external environment. There is Tittle 
reason to expect the user to sift through and evaluate an assortment of products 
on^the possibility that ^gfe may be one that does f&l a 'need. This is just 
not compatible with the user's orientation. The existence of unfilled needs 
does imply that the user will be responsive to the marketing approach. The - 



) -■ . • 



marketing approach- seeks to develop prbducj^s out of unmet needs, thereby en- * 
suring responsiveness. , 

The generaj. design of a marketing system for ed^ucational R&D ±b shown in 
Exhibit I, and follows directly from the points we have made. Contrasted with 
the general marke^'ting design in Exhibit 1 is the change agent design^ Note that 
the change^agent design begins with the R&D process. A product is created, 
undergoes change agent advocacy, and tSen is diffused through the user system.* 
This last process, however, is outside the control of the'organization wfich 
has developed the product. It is left, as l^as been indicated, to natural forces 
within the^ user system. ' . / 

The general marketing design, however, does not begin with the R&D process^ 
reover, it carries the product far beyond the R&D process. The objective is 
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in fact to embed, the R&D j>rocess within the organization so that, it t's 
entirely responsive to user needs . ^ All products, even those stemming from. 
basic research, are developed in the context of an analysis of the needs 
pf^a ^particular- group of users. These needs define the market. The market" 
shapes the product. The market analysis process attempts to ensure that the 
R&D process full/ considers tiser needs. Once ^ prpduct has been developed,'' 
it still must be subjected to the strategic marketing process which seeks to 
tailor the product even further to user needs. All aspects of the product 
(price^i etc.) are considered in this process. - ' , ^ i 

In understanding how this general design could be Implemented, it is ^5eful 
K ^ 

to ind,icate how the marketing tasks (described -in Part II) fit into the market 

analysis process and the strategic marketing' process. Both of these processes 

^can b*est be understood as the sequential implementation of the building block 
tasks we have already discussed. 

'A flow diagram of^^the^market analysis process is shown in Exhibit 2, The 

■ . ■ 14 ' 
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building block tasks have been described and related to education in ^art II* 

emphasis here is oq the interconnection of the various ^asks to form an 
organizational structure/ As can be seen from Exhibit 2» the market analysis 
procfess bajsically has a linear » stei^-by-step structure. EacTr task talcbs the 
'previous one as ^n input* 

, ^ The process begins*with the identification of target users. Anyl number of 



coA^ltderdt^idne may come into play here, such as long run objectives, current 
crises which may be affecting the educational system, the desire, to hslp pre- 
viously disadvantaged users, and breakthrough product ideas. The task is to 4?:aw 
together these consideratipns , whatever they are and wherever they crtme from, 
and to specify their implications, not for a product, but for the gnr >up of users 
to which the organization wishes to be responsive* The more limiting the rele- 
vant considerations are, the more narrowly defined will be the target group. • 
But the point is that the3e considerations must be analyzed up fronp and used 
to define the group of people for whom the marketing approach is tol be built. 

The next two t^sks are performed in parallel, as ind legated in lExhibit 2. 
Once ^^ target group has been identified, an attempt l;5 made, usually entailing 
research, to determine the unmqr needs of this groG^l Since the jexprjession / 
of these needs will.be channeled through the decision-making strilctu^e of 
the user organization, thi^ structure must be analyzed simultaneously with 
the needs analysis. It is necessary to understand how the individOal usi^^s 
needs interact with those of other people in the user system. It cannot be 
assumed that the needs of the target group arc simply the sum of -tUc needs, 
of the individuals making up tlicfgroup. Needs must be analyzed in the 
Context of the user decision making process. -^^ * » 

Onc^ an understanding of tlic target group'^ needs has be<in achieved, it 
is still necessary to dctcrmfnc how these nccds^will be reflected in actual 



opinions. -The existence of a need wlthln.tliQ target ^group docs not necessarily 
imply receptive opinions and behaviors. It is important to dingnose ho^^, thc^«?e 
opinions and behaviors may block or facilitate satisfaetion of the underlying ^ 

need. ' ^ / 

The result of themarketing understanding iShase is to achieve a thorough 

K ' - ' / ' ^ * ' . . 

understanding of the target group. Based on this understanding, the . ^ 
segmentation phase addresses the key question of whether the target group 
can be satisfied most effectively ^as a group or as subgroups. From the 
understanding, achieved of the target group, segmentation ^ariables are 
selected which represent the major differences within the target group. Arf 
this point the market analysis process m^st begin 'to focus on the set of needs 
vhich may be satisfiable. Segmentation V^iables are selected for each need. 
Research is then necessary- to confirm thaA<^tisers do in fact differ in terms 
of the variables selected. Finally^ the segments derived for each n6ed must 
,be examined in terras of the organization's Resources and objectives ih order 
to" determine if it is worth treating each as a separate target- group. 

This. then is the market analysis procejss: a step-by-step implementation of 
the building block tasks. ^ What is important to retogniz^ is that the output ot 
this process supplies strict giAdance to the R&D process. R&D receives criteria 
for what the product must do and the variations it must have to satisfy optimally 
different' segments of users. Various other characteristics of the user segments 
in the form of opinions and behaviqirs that may affect usage of the product are 

J, * * 

i • \ ^ 

available to. guide development. 

There is no possibility after the ma^:kct ^"^nalysis process for R&D to 
make a product without fully considering the user. No product which does 
j\ot relate to a specific need o£ a user scp.ment will be developed. Unlike 
the cl^angc agent advocacy dcslan, which begins wRh the R&D process 

18 ' ■ ' 
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(see Exhibit 1), products do not xrome out of R&D to be directed at possible 
users. They are directed by the user, via the market analysis process, through 
the R&D pro cess • * « . ^ 

• * • < . ■ \ 

—It is .important to note that the market analysis process, by design; will 
function to limit the quantity of products coming out of R&D, Because each 

product must receive more attention, educational R&D would tend to turn out sub- , 

* ^ — "T 
stantially fewer products if redesigned following the marketing approach. But 

these products should be of superior quality^rom the point of view>qf users, 

A flow, diagram of the strategic mar)teting process is shown in B??hibit 3 

in* the context of the general marl^tlng design which we are proposing. Unlike 

the market analysis process, tasks within the strategic marketing process are 

not in general arranged in a step-by-step task sequence. This organizational 

structure follows from the fact that the goal of this process is to integrate all 

aspects of the product in order to achieve truly optimal user satisfaction. Once 

R&D has developed a product, all the decisic^s related to getting that product^w 

to the user are considered from the standpoint o^N^er .satisfaction. 

The most- important feature to notice irt Exhibit 3 is that the R&D process 

has itself becqme a part of- a larger strategic effort, termed new product de- 

velopment. Even with the input from the market analysis process, the R&D process 

is not allowed to function without direct feedback from the consumer. The 

various steps of concept development, screening, and 4:est marketing (cf. Exhibit 6) 

■i • . . ♦ 

are ^11 designed to relate the product ba,ck to the user while it is still in the 
R&D process. If at any poiirt the product does not measure up to ^he input cri- 
teria of the market ^nalysis^ process, the R&D process rnu^t start over^;^^in, 
. If test marketing indicates that the developing product does not fulfill the 
user need in the way prescribed by the market analysis process > or if the product 
runs into some new obstacle not anticipated^^J^ the'^earlier process, this user v 
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feedback must^be taken into account before development work proceeds. 

Bven when the prpduct emerges from R&D» having satisfied the requirements ' 

^of the neir product development strategy, it still mu^t undergo the product, 
' ' ^ * " <- ^ ^ " . * ^ ' ^ * 

• ' pricing'^ distribution, and promotion strategy tasks. It is^ assumed that tKe. 

, user ultimately re'acts to' all aspects of t)ie product and tHat the^e must be 

^ ' . ' ^ / ^ ^ 

,. adjusted to optimal satisfaction as well/ HenCQ, it is necessary to examine 
' • ' ' » • «. 

' the relationship of the product, from the^user^s point view, to other related 

products being produced the organization.- Again, the idea is to integrate* 

• • , ■ : • ' .\ . 

all these strategic elements into the best product possible for the target 

i . segment* % ' ' . , " 

* * ' . \- ' ' ' ' ' - I ' ' 

\ The*f fnal provisi'on in the marketing design 'in Exhibit 3 is for a control 

h t , • -» * • 

process which has been implicit ih our discussion 56 far.* The marketing ap- 
' ' preach clearly dictates that the user's satisfaction with the final product 
be monitored "over time for changes. If changes are detected, depending on 
their degree, fhey are fed back to reinitiate the strategy ta$ks or the market 
,analys is, process itself. * ' * , ' 

II* Educational Marketing Tasks 
Jjci'the previous section, we^identif ied the task^Hbrequired to operationalize 
the marketing concept* Now we shall focus our discussion on elaborating what 
is involved in performi'ng the tasks iden.tified In an educational context. ' 
SpecJ.|lcaily, phree tasks are: (1) understanding the market, (2) segmenting 
© or dividing the market in accc^rd iith product users' needs, and (3) orchestrating 
marketing Instruments to satisfy users' needs* • ^ • ♦ 

^ask 1: Understanding the ^farket for 4vducational Innovat ions 

■ : . — — — , ■ • • -tV- ■ 

' ^ I'undamental to employing a marketing approach to the diffusion of educa- | 

, tlonal innovations is a clear, understanding of the market for these Iftnov^tions. 
This entails .performing the following subtasks:^ .*(iy ide;itif ication "of the ♦ 

ERIC r « . . * 



target rtnarket; (2) analysis of target market needs^ (3^ assessment of the 
decision-maW^g process employed by the target. ^Each of these 4ubtasks^ is 
discussed "in. the following sections. > . 

Target' Market Identification " ' ^ ' ' 

,The initial step irv target market identification i,s the specif icatfbn of 
all parties who are likely^ t<3fc be influenced bj^^the adoption and implementation 
,of the educational innovatiojf^'f interest. For example, vhen the University 
of Wisconsin was attempting t:o\^gain ado^on of a multiunit elem^tary, schooI,(MES) 



focus centered not oniy on the individual or organization which made the 
adoption decision, Such as the .local scffbol boird, but also with other parties 
affected by the adoption of 'MES. These' p^i^s included state educatiopal 
Agencies, elementary school adininisirators , teachers / students %nd parents.^ - ' 
The important point is that target^^rket identification must entail specif icac 
tion of all concerned parties since successful diff«sion-of an innovation re-^ 
quires that the needs of all these patties be considered, Furthepnore, the. 

relative^importance of the various parties in the. adoption p^p^ss may vary ^ 

^ J ^ • . 

accprding to the nature of the innovation, a.nd the greatest" emphasis should 

be given to the needs of those parties mostf directly affected -bV the innovation. 
Need Analysis ^. ^ " ^ ^ . * 

Once the target market has Ween ^identified, a need analysis must be cdn- 

• - * 

ducted for each of the^ parties in the target. The first step in\ need analysis -> 



*is Specifying the needs of the targets in'd'^^'il. I t^o;fte'n entails 
an examination of archival data. These data lncl^^Je^' ^s^udentf per- 
tormance on- tests measuring spoeific^ skills, records of successful and unsuc- 
cessful attempts to diffuse previous educatiohal iSPhovations, teachers' budgetary 
allocations designated for particular purpose^^ata collected as part 'of pre- 
vious re^search, and.reco.rds of requests fcj^i^K^arious educational, materials. 



There, are specific reasons for collecting each of these types of data. . 
Student performance on tests measuring reading, math an4 vetbal skills Could be 

examined to identify arenas where performance is poor. This might indicate a 

/'•...* • ^ 

need ^or' more effective teaching methods apd tools dn these are^s . Records 
of previous attempts to diffuse educational innovatiohs could also be examined 
to generate insight regarding target nee?is. >The needs 'fulfilled by innovatio^is 
which were successful might be contrasted with t\ie needs served by ones which * 
failed to obtain some notion about the importance of these various needs.' 
In addition, any systematic efforts to determine the reasons why a particular 
innovation failed to^^^^ acceptance may also provide insight into needs. 
Teachers' budgetary allocations to particular area^ may provide an indication 
of their needs for supplementary teaching materials. Existing literature and 
dat^ collected as part of previous research pro3ects might al"So he examined 
for clues regarding ' the needs o| the target. This might include thtf focal, ^ 
organization's own research as well as research conducted by other organizations 
such as universities, regional centers and lab§, SEAs and I^EAs. Finally, * 
valuable information regarding target needs may be obtained by simply .examining 
the requests for materials and information whi6h are made at all levels in the , 
educat|.onal system. For example, requests which ^teacher.s make to th^ir school 
administrators,, LEAs and SEAs regarding desired information and materials pro- 
vide an indication' of their needs. 

After archival data has been examined, tlJe organizlftion may have some - 
general notion of targets' needs. However, since 'this information is derived 
'from data collected for some purpose other^than need identif icit^ion, it is 
'likely^ to b^ incomplete. As a result, it may be necessary to collect additional 
data to heJLp define target needs. Two methods exist which cUfj^ be employed 
to collect this data: observation and direct -questioning of the targets. . In 
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some instances, it may be feasible for t^he organization to 4raw inferences 

about target nee^ds by simply ot)serving the target in the edu<3ational • system. 

Conclusions about teachers* and/or students* needs might be'drawn on' the basis 

of observing^ teachers* and students* behaviors in the classfroom* Alternatively, 

target groups might be asked to express th^kr needs directly in .either i^ormal 

personal or group interviews or through structured questionnaires. ^ j 

Once the target. *s 'needs have been defined, the organization must assess^-^ . 

how well these needs are met by the offering? of other organizations in the 

^educational system. While many needs may b,e served by the products of these . . f 

other organizations, some needs will probably be unmetj The focal organization. 
*^ > • ♦ ' • 

^^st^^^hen determine which of these unmet needs it can address most effectively. 
Decision ->laking Processes 

In addition to identifying the target market and specifying the needs 
to be served, the, organization must understand how the target makes decisions 
to adopt or reject new px6ducts. Tliis decision making inVTolvcs two processes r 
(1) the^ interaction between the various individuals involvednUn the 
declsrion and (2) the development of points of view -by the individuals 
involved in» the decision making. Knowledge of bot;h of these p;cocesses is * 
basic to facilitating the exchange process. * . ' ^ 

The Buying Center , The buying center refers to all of the. parties 
involved in the? purchasing or adoption of innovations and the regies played 



by these parties. As we noted in our discussion of target market identi- 
fication, many individuals other than the actual purchaser of an educational 
innovation participate i*n the purchase decision. In fact, there are at 
least five roles which an individual can play in a purchase decision: 

\ 

(1) Initiator - The initiator is the person who first suggests, the 
idea to purchase a particular educational innovation. 
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^ (2) Influcncer - An lnfluenc«r Is a person-who explicitly or ' *; 
^Implicitly carries some- inf luefice on the final decision. 
(3) Decider - fthe decider is a^person. (or pers'ons) who ultimately 

determines what action shotf^d be taken: whether to b'uy, what to 
buy, liow to buy, when to buy. and where to buy. 
"(4)- Purchaser - The purchaser is the person who makes t;he actual 
purchase^ ° . 

' y ' , . . , . • , 

- <5) User_- The user i^ the person who operates the product or ' 

service. 

In. a particular -situation the'same individual or group of individuals may play 
several roles, and sqveral different individuals may play the saine role. Fur-' 
thennore, the individuals or groups who play the variou^^les may differ across 
situations. Understanding the roles tVat different groups or individuals in 
the target play In the decision to adopt is important because people in dif- 
. ferent roles may require different types of inforniation' about the innovation. 
Opinion Formation ' • ' 

Regard^less of the role that members of t|ie target market play in 
the purchase decision, they reqiiire information in order to- form their - 
opinions. If an organization is to be effective in .providing such ' , 
Information, it must have an understanding of hiw individuals process and 
utilize information. In this sec^tion,we will briefly summarize a mc^el' 
of information processing and i<Jentify its impU-catLons. 

The informatlon^rocessing model is depicted in Exhibit 4. The model 
. interprets behavior as a function of information transmission through " 
several necessary, ^t not sufficient, stages. Thus, one. must be exposed to 
Information before it can be received. Yet, exposure Is not sufficient 
for -reception. In -t^n, given that an individual receives the information, ' 
there is some probability i:hap he/she will choose to accept or reject it. 
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Further, acceptance or rejection of the information Is a c^cessary, but 

not sufficient, condition for retentfon. Finally, information which is 

retained may influence intention and, ultimately , "flttual behavior. Let 

us now examine the model "components in more detail. ** 

( 

Exposure to information entails the physical presence of an individual 
at? the time the information is being given. Exposure is a function of two 
factors: the environment and the utility of the information. An individual's 
environment controls the information that he/she is aware of and, therefore, 
exposed to.. For example, teachers are likely to read education journals, 
attend teaching seminars, and associate with other teachers. Thus, if an 
organization wants to insure that teachers are exposed to information about 
an educational innovation it must first make them aware of the informa.tion 
by placing it l!n their environment (i.e., in educational journals, at 
teaching seminars and conferences, etc.). However, careful placement 
of the information in the target market's environment will not be sufficient 
to guarantee exposure. Given awareness of information, an individual may. 
decide to expose himself/herself on the basis of the perceived utility of 
the_^information. * • & - 

The utility of information is a function of two factors: (l)|^ertainty 
about one's position and (2) decisional importance. Certainty about one's 
position depends upon the quantity of informatlaOM||g. i amount of past 



^Ith TBi 



Information and experience the individual has wfth respect to the issue), 
quality of information (e.g., is the Informatloa current or out-of-date?), 
and the, consistency of the Information (e.g., ldoes all the information 
support a particular approach, etc.?). When an individual Is highly 
certain about his/her position with respect to a particular Issue, he/she may 
see lll;tle utility In additional Information and thercfbre chooae not to 
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•expose hi^seif/herself to it.^ The other factor which influences an individual's 
evaluation of the utility of additional information is, the. importance of a ^ 
decision. . This factor is related to the economic, social, and physical costs 
associated with the decision. As the'se costs increase, the utility of additional 
information and con^quently the probability of exposure to such information 



increases . 



Given that an individual is exposed to information, there is s6me probability 
■that he Will receive the information conveyed. Reception involves the processing 
.nd comprehension of information. Individuals are most likely" to process in- 
fonnation ^hich is salient to them. For example, a teacher who is very con- , 
cerned about how to teach reading effectively is likely to process information . 
on this topic. If the salience of a to.ic is low for a particular target it 
be increased linking it to something which has high science., 
Reception is' also related to comprehension. An, individual's comprehension 
of information may be enhanced by insuring that thd information is connnunicated 
sitnply and clearly. In addition, repetition of information will help insure ■ 
reception by increasing the probability that.the information will^e processed 

and understood. » ^ ^ 

■ once l„fo™atio„ Is received it ..y undergo further processing by the 
lndWn.1 end be either accepted or-rije;ted. the eccept.nce or rejection 
o, the ■infor.atlon 1. ^ function of the Individual's Initial opinion and the 
■ effectlvenea, of the argu.ents advanced 1^ the co^unl.atlon. If people, have ' 
a Strongly negative predisposition to an Innovation. It Is unlikely that Infor- . 
^tlon ;iU cause a dra.atlc change In their opinion. Consequently, the organi- 
sation .ish to exclude such Individuals fro. .the target market. In addition,- 
th. argu-ents presented In the co»unlcatlo„ .111 Inf luen>:e the acceptance/ 
ejection of the lntor.atlo<~^rte co».u„lcstlo„ .111 g^lj) greater acceptance 



if the arguments advanced relate tsp factors uhat the target considers important 
and if they are substantiated by evidence unfamiliar to message recipients. 
If |nformatlon Is acceptied/or rejected there is some probability that it will 
be jiretalned or stored for^ further use In forming Intentions and behavior. Thte 
projbabllity that Information will be retained can be enhanced by the use of 
repetition. * . » 

We hav^ now summarized the process by which opinions are formed. 
However, organizations typically are not concerned about d«velo/lng favorable 
opinions toward their products or Innovations per se. Rather, they are 
Interested In developing favorable opinions because they believe that these 
will lead to favorable behaviors (l»a^, adoption). While existing research 
Indicates that attitudes are consistently related 'to behavior. It has also < 
been demonstrated that attitudes are only a partial explanation for people's 
behavior. ^ Consequently, organisations must be sensitive to, others factors^ 
'which Influence behavior. Two factors other than attitudes referenfce 
grojups and unanticipated events have ^a significant Impact on behavior. 
Individuals are' often Influenced by what they believe that others who are 

important to them (e.g., family, frJLends, co*worWfers, etc*}, expect them to 
do In a particular situation. Therefore, In communicating with the target 
market the organization should he aware ^f the Importance of these reference 
groups and attempt to obtain and communicate their"* support for the DrodUct 
or innovation. 

It ha^ also been found that behavior Is facilitated ot inhibited by 
unanticipated factors In the environment* For' example, a teacher who 
Intends to order materials necessary to employ a^ particular method of 
teaching^ reading may be dissuaded from doing so if he/she discovers that the 
materials are out-of-stock and will take three weeks t6*gct* On the other 
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hand, a teacher who is uncertain abo<it which type -of reading materials to order 

may be encouraged 'to order a partlculaj set if he/she discovers that that set 

** * « . 

is available at a special, low introductory priced The organization xntist be 

sensitive to the fact that factors in the environment may either facilitate ox; 

inhibit the behavior it desires and therefore it must take steps t©^ maximize 

the facilitators and eliminate the inhibitors ♦ 



In sum, effective marketing of educaticnal products requires an under- 
standing of user needs. In this section^ we l^ave "bt^ lined a model of how 
educational decision makers process and use information to make product 
deci-6ions« This sj^enario provides a. framewoi^ for conducting research to 
identify consumer needs. In turn, by employing this framework far conducting 
research, it is possible to assess the extent to which a new educational 
product is likely to meet ^cons.umer needs and the reasons for the acceptance " 
of products that have been on the market for Some time. 

Although the performance of the comprehensive market analysis stages ted ^ 

above is likely to increase the utility of the products developed, it is 

employed only in'isolated cases in educational product marketing. In part, < ' 

this is attributable to the production and sales orientation that Has been 

adopted by educatfc^al- product marketers.* In part too, it is due to the 
t 

fact that the cos^t of the comprehensive market analysis outlined is prohibitive 
for a partifciilat developer tp perforin. / 

; ■ - \ / 

If the- marketing efficiency of educatiojial p-roducts is to be increased, . 



tiere must be, a reconceptualization of the way market analysis is done. One ^ 
way to proceed is to a3sign spe<^fic research tasks to particular instit}itions< 
Generic research, which addresses what educational decision makers perceive 

f" — ^ ■ 

to be major prob^eons and describes how they cope witb these problems, would 

' ' ' ^ • i\ 

be catalogued , and disseminated via some centralized institution such 'a^ NIB^. . 
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Generic research data would also Indicate the extent to vhich. existing producta 
^ave been disseminated successTfuIIy, and the reasons for the observed levels 
of performance*^. Developers of educational products would be required to 
justify proposals for R£D work by demonstrating (hat generic research data 
is* congenial with the product they plap to develop. It would also be 
necessary for developers- to outline reasons for their belief that the 
* pVoposed R&D work would yipid a product that is not already* on the shelf. 

By requiring developers to use generic research the likelihood of ^ 
developing high utility educational prpdubts is enhanced. However a 
' second type of market analysis is required. This type, termed prodbet 
research, should l)e .conducted by the developer, in contrast to generic 
research, v^ich identifies problems and the adequacy of existing products 
in -resolving these problems, product' research focuses on the efficacy of" 
a- developers' product in dealing with a specific^problem. As an integral 
part of the R&D effort, developers would conduct research to: determine the 
degree of acceptance of their product and the. reasons for the degree oi 
acceptance observed. This information would be {isedto modify the product 
or discontinue development work prior to its mass disa^^nation. 

To insure that a product research program is an in^gral part of the 
560) effort, a cer^in portion of the research funds provided to a developer 
^would have to be allocated to product research. This approach is congenial " 
■Wiirfe^ NIE's previous practice, though 'it differs in.ari important respect. 
Rather than allocating funds to 'iAsure dissemination as was previously done, / 
fund^ would be alloacted for product research. Ihia would insure- that th«-^ 
products developed meet 'consumer needs prior to their dissemination. 
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. The segi/fegatlon of research Into generic and product components 
suggested above has several Important Implications. It enhances the 
likelihood that new educational products address user problems. It reduces 
the chances that hew products simply duplicate previous R&D efforts. And, 
it makes market analysis economically feasible. In essence, J>y following 
« marketing approach the increased investment in market analysis in relation 
to current expenditures will be more than offset by the decrease in dissemtn- , 
ation expenditures. Ihe overMl result is likely tQ be greater marketing 
efficiency. However, if this outcome is to materialize, a centralized 
institution such as NIE is required that effectively gathers and disseminates 

:'.) 

Task 2: Segmenting the Narket 



^eneVic research data. % 



One assumption which could be made about the market for educational 

V 

innovations is that it is homogeneousl'-thtff^s, all potential adopters 
(e.g., schools, teachers, etc.) are essentially the same. However, It is 
readily apparent that potential ado^;©r« differ in many, ways which are ^ 
relevant-^to new product adoption (/.g., they differ in their needs, attitudes, 
locations, etc.). Consequently, an prganization may find it advantageous 
to segment the target market into homogeneous subgroups on the basis of 
characteristics related to product adoption or use, and then employ different 
marketing programs to serve .the needs of these different segments 
Bases for Segmentation 

The target for educational innovations may be segmented on the basis 
of a variety of factors.- Of focaj. concern here are geographic, demographic. 
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and behavioral bases fof segmentation. 



Geonraphtcal seRmentatlon entails segmenting the target market on the 

basis of location '(c.^. area of a city, county, country). This type of 

» ♦ . ' ' ' 

segmentation is useful when there are specific geographically induced 

\^ differences ifi' product use patterns and/or attitudes toward' the product. 

Demographic segmentation entails .subdividing the market on the basis 

of demographic variables such as age, sex, income, education, and social 

cla8s«^ This is one of the most popular bases for segmenting the marketplace, 

largely because consumer needs and usage rates are often ^related to demographic 

variables. Also, demographic factors are easier to aeasure than^ other types 

of segmentation variables. 

Behavioral scgmbntation refers to subdividing the target market on the 



basis of some relevant behavior. Forvexample, firms often choose to concentrate 



their efforts <m the 



has limited resource 
uses tl^ innovation 
" Having examined 
organization determi 



heavy users of a particular product (i.e., the indivi^ijial 
who purchases the prpduct in large quantities and/or frequently). This 
strategy may be appropriate in educational sitings when an organization 

is and desires to reach that segment of the market which 
fi^rst. - . ' 

bases for ^segmentation, we need jto Consider how an 
tines whether or not a segment is attractive. Of course. 



as we noted in our cliscussion of target market needs, 'an organization should 



focus on segments of the market wlvDse needs are unmet or inadequately met, 
and whose needs the organization has the expertise to meet. However, simply 
focusing on segments with unn^et needs that tha organization can" address Is 
not sufficient. In addition, the organization\must establish that the 
target is measurable,' accessible, and sobstantiai. Let us consider eath of 
the^c criteria- 



id 
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The mcasbrablllty of <a segment refers to the degree to which informatton 
exists or is obtainable .for a particular buyer characteristic\^nfortunately , 
Mny suggestive characteristics are* not susceptible to easy measurement* 
Thus, even though a^ teacher's classrobi style is likely to influence his/her 
adoption of innovations, this dimension may not be a useful basis for 
segmentation because it is difficult to measure. * 

The accessibility of a segment refers to the degree to which an ' 
organization can effectively focus/its marketing efforts on chosen segments. 

'This is not possible with all segmentation variables. It would be useful if 
media (e.g., teachers journal's) could be found/ which would only reach, ^say, x 
innovative teachers, but it is likely that these teachers are exposed to 
'the same media as non-innovative teachers. Consequently, even if 

*innovativoness is related to adaption of new teaching tools it may have 
little practical value if there is no way of efficiently reaching 
"innovators." * 

^ Finally, to be meaningful a segment should be substantial or large 
and/or profitable enough to be worth consid'eri^ng for separate marketing 
cultivation. It may not be worthwhile for an otfganization to develop, a 
separate product or program for serving the lieeds of, very small segments 
Although organizations involved in the development of educational innovations 
may not always be concerned with making a profit, *t,hey do have limited resources 
to spend. Therefore, they must be concerned with whether a particular segment \ 
is substantial enough to warrant the allocation of resources necessary to meet 
its needs. This does not. imply Xhat resources should not be spent against small 
segments. Rather, the point is that the number of people affected" should be 
considered in deWioping a segmentation strategy. 

» 

Task 3; Developing a Marketing Program 

In the previous sections, we have discusser! the market for educational 
Innovations. After an organization has identified its target markct(s) it 
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miist.then develop a marketing program which will meet the needs of these tDarket(8). 
This involves decisions about four -major factors wljichare under the organiza- 
tion's coiitrol: .product, price, distribution or place/^promotion. These 
factors together are often referred to as the marketing mix (see Exhibit 5).. \ 
. - Exhibit 5 - ' 
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The Marketing Mix 



In the following sections we will cShsider each of the elements of the marketing 
mix. Although each element is discussed separately, it important to note 
that ail the -decisions regarding the marketing mix are Inticrelated and are 
ultimately a fuqction of the target market that the^.organ/zatlon is attempting 
to serve and the nee^s of that target. ' ' . % 

Si 

Sub-Task; Pro duct . '* 

'■ ' — 7~ • ' 

Two basic issues must' be addressed with respect to product: •a)j'hat ' 

products or innovations should Be oife«d to the market? ,and (2) how can trial 

of these products be encouraged? Each of these Issues will be considered- In turn. 

Establishing the Product line." Determination- of what products should be' 

offered to the market typically involves the process summarized in Exhibit 6. 
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Exhibit 6 - 
New Prf^pduct Develo^^^t 
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AS the exhibit indicates, new product de^/llopment " should begin with an under- 
standing of the needs of the., market . On the basis of this understanding, members 
of the organizatiln may engage in idea generation regards products.' Th.se 
ideas may then be screened by. using qualitative research techniques with members 
of the target (fe'g. . focus group interviews. iY.-depth interviews, etc.) to assessf 
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Utget (e.g., focus group. Interviews, In-dcpth interviews, etc.) to aiae^s ' 
WweU the new product concepts meet the market's needs. Those concepts 
^ vHich appear to have the potential to meet the market needs may then be 
■ evaluate-d -in terms of ^organization goals and capabilities. Concepts which 
.are comij^tible with the goals and expertise of ^the organisation undergo 
. , further dev^opment. Prototypes of these' products may be developed and 

tested. TKis testing is used to refine.the product so that it better meets 

the needs of the target. Next, the product may be tested in a field setting , 

(test marketed) to check its performance and acceptance under actual usage 

conditions. In addition, the field te'st may be used to examine the adequacy 

of strategies with respect to other elements of the marketing mix, such as ' \ 

price, distribution, and promotion. Finally, if the product performs well 

in the test market it may be introduced on a broad scale to all target 

members • , 

News Product/:^noVation Trial. Product adoption is facilitated by gaining* 
trial. In turn, trial is enhanced if the product possesses certain- attributes. * 
Rogers (1962) has identified five 'attributes that influence the 'rate at which 
a new prodtact/ innovation becomes a*^ted: 

"^^^ relative a dvantage of the new product over existing products. ^ 
' The greater the relative advantage, the more rapid the adoption. 

compatibility of the new product with the lifestyle of members 
of the, target: The more compatible with the target's lifestyle 
that the new product is, the more rapidly* it will be adopted. . * 
However, .compatibility should not entail developing a product 
that is highly similar to those in existence. 
(3)- .The complexity of the new product. The more complex .the new \ 
product, the slower the adoption. 



o « 37 / 



(4) The communlcablllty or extent to which the new product's function - 

«^ 

and features can be described tq someone who has not seen or ufeed 
the new product. 

(5) The divisibility of the product, or the degree to which the 
product can be tried in small quantities on a limited basis. "If 

a product is divisible this will enhance the probability of * ^ • 
adopt io\i. 

On tlT^ basis of this analysis, it carf be seen that products which have a 
significant' relative advantage and are compatible, communicable, and divisible, 

' but not highly complex, will be most rapidly adopted. The effects of these 
factors can be better understood in terms of the Information processing model 
developed in Task 1 and Exhibit 4: High communicabiiity and low complexity 
Increase adoption because they enhance the probability tnat information about 
the product will \>e received and understood^ A significant relative advantage 
and h£gh compatibility increase the probability of adoption because they enhance 
the probability that information about the product will be accepted. Finally, 
divisibility increases product l&option by increasing the probability that trial 

^ (behavior) will occur. ^ 

Characteristics of the target also influence the rate of product adoption* 
It has been observed that the adoption process ijiay involve two steps. First, 
the organizatJLon which has dJ^eloped the product/innovation communicates about 
it through mass media (e.g., wurnals, publicity on\^, etc.). The communications 
reach opinion leaders who, in tarn, communicate through word-of-mouth about the 
innovation to the masses (e.g.'>\the rest of the target market). This process 
Is important because if organizations can Identify and focus on these opinion 

ERXC"^"! the opinion leaders ^will .facilitate information dissemination about the 



innovation. Increasing the efficiency of the'communication process. While it is* 
often' difficult to identify opinion leaders^or particular products, since they 
tend* to be like non-opinion leaders only more experienced^ it mj^}fh possiSle 
to use records of past adoptions to obtain an idea of who the opinion leaders 
are^ For example, in educational situations^ teachers or school systems which 
have historically adopted educational innovations early in the adoption process 
might be considered to be opinion leaders. ' ^ 

Sub Task; Price ' ; 

! ^ 

In this section we shall address several issues related to the pricing of 
products. Firstj, a number of factors which must be considered when establishing 
price 'w^^ll be detailed. Then, two general types of pricing strategies will be 
outlined and the circumstance*s under which each of theise strategies as appropriat 
will be specified. 

Considerations in Setting Price . Typically an organization pxic'es a product 
with the objective-of covering both fixed and variable costs and making a profit. 
However, the situation may be' somewhat different for educational organizations/ 
Many of these organizations develop and disseminate theii; products , under 
grants from agencies such as NIE, Consequently, some or all of the fixed 
costs associated with development and dissemination of these products do 
not represent "real" costs to the organization and ft may not be necessar^y " 
to price the product in a manner designed to recover these costs. In 
addition, some organizations' which develop *bducational innovations are 
nonprofit organizations and thus are next -ctrtTcef ned with profits when pricing 
their products. Therefore, organizations which develop educational innova- 
tions may vary in their procedure for pricing their innovation. Profit making 
organizations pay set price to cover all fixed and variable costs, and provide 
a certain level of profit. In contrast, nonprofit organizations may set y 
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price In a manner which simply covert all fixed and variable co^s^. The* ^ 
important thing for any organization to do when selling price is to detertnih^ 
what costs must be covered, wliat level of profit, is desired, and how price 
will impact on demand (and thus influence costs' and profits) and then 
establish .a price consistent with these factors. 

Pricing Stratejtics . In developing a pricing strategy for a new product, 
* two strat^ley are available: skimming and penetration. A skimmr^^^i c img 
strategy entails initially pricing a new product at' a rel^t^ively "high leveT 
to take advantage of thejA^ct that some buyJrsShs^ willing to pay a higher 
price than others, and then over, tttne reducing the price to^ftCtract additionaJL- 
customers. This strategy is most appropriate when: - , ' 



(1) there *are a significant number of peopTe'^o are wlHing to pay 
the initially, high pric^ 

(2) there are barriers to competitive etttry, such as patents*" ' » 
(otherwise high price would ^ake competitive entry likely^^v^^ 

(3) there is a desire to recoup the investment made ii>-*rtir=pr«rfLict 
quickl)^; . 

(4) price Is used as ati index of quality, and quality is desirable. 

An alternative to skimming pricing is a penetration pricing' strategy^ 
It entails setting the price of a new product at a relatively low level in 
order to capture a suUstantial proportion of the market quickly (i»e., 
peq^t^ate the market)* This strategy is best used when: 

(1) purchasers are price sensitive; * " - ^ 

(2) unit^ costs of production and dif tribjiitldn decline as/ou,tput^^ 
r increases; and 

(3) 'V^a low price is likely to' discourage actual or potential competition. 



V 

a&tual or potcn 

:\. - - 

/ ^ • . 40' 
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* Although either a skimming or a penetraticm strategy could be employed 
by an organization introducing an educati^naf innovation, a penetration strategy 
appears to be more, consistent with the goal of- rapid diffusion of educational 
innovations, Furthermore, since adopters of, educational Innovagtions are likely" 
to be-highly price sensitive in light of the fact many schools. are experiericitig 
severe budgetary problems, a penetration strategy is appropriate. 
Sub-Task:. Channels of Distribution • ^ < 

■ The Structure of a Distr ibution di^s^ . The distribution of product inno- 
vations entails the movement of innovations from the point where they are 
deveiopedXto the point (s) where they are adopted and implemented. Channels 
of distributiSrVary on two basic dimensions: the number of different inter- 
mediaries and the number of each type of intermediary. A ch^nel of distribution 
maybe direct or have no Intermediaries, as shown in Exhibit \ or may be in- 
direct ^nd have several intermediaries as shown in Exhibit 7^. 



a. Direct Channel 
Producer 



Consumer/User 



Exhibit 7 



' b. Indirect Channel 
• Producer 

Intermediary 1 

Intermediary 2 

Consumcr/Uscr 



'4' 



^he de-cision regarding the 'number of different types of Intermediaries and the 
number of each type of intermediary should be made after a careful consideration 
of .the characteristics of the product, the market, and the producer. However, 
before turning to a discussion of these factors, the functions performed'by the 
members of a chaSnei^of distribution require examination. 
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Functions Performed bv Channel Hembars . Members of the channel of distribu- 
tion must pe'rform three basic types of functions: exchange/distribution, and 
facilitation. The exchange , function involves the actual buying and celling of. . 
the product or innovation. In the direct channel depicted in Exhibit 7. ^the 
producer and consumer would perform the selling and buying functions, respectively 
In more complex channels of distribution, several channel members may perform . 

.each of these roles. 

The distribution function involves the act;ual transportation, and 
sometimes storage, of the product. Sometimes the producer may perform this 
function by sending the product to the xonsutner through the mail or some 
other mode of transportation, while in other instances either ati^^jgnnediary 
or the consumer may perform this function. 

■Finally, there are a number of facilitative functions performed by 
channel members w^ich expedite the exchange process. These include providing 
financing for purchases, informing potential' copsumers about the product, 
and assuming the risk associated with the introducti'on of a new product 
(e.g., R&D costs). Different members of the channel of distributiotbmay 
perform each^f these facilitative functions. An interme'diary may provide 
financing for the purchase of expensive educational innovations. A producer 
may take charge of disseminating information about the product.. And a 
facilitative agency such as NIE may assume much of. the "risk associated with ... 
\v.new product introduction by providing funding for the project. 

These three basic functions are. inviolate,^ though they nfay be performed 
by different channel members in different situations.' The decisions regarding 
• who shall perform th9se functions should be based on an assessment of who can 
-perform them most efficiently. This, like other channel decisions, is a 
function of characteristics of -the product,'*thc market, and the producer, 
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■ - The Impact of Charact&rlstlcs of ^h e Product on Channel Decisions . Four 

major characteristics of the product impact on channel decisions: 

(1) knowledge required to sell the product, * . /- 

/. (2) seTrvice requirements of the produ^j 

(3) perishability of the product, and 

(4) unit value of the produ,ct. ' ^ ' 

■ If substantial knowledge is required to communicate effectively about the 
product then a direct channel in which the producer performs the "selling" 
function is usually most appropriate. This is because the intermediaries avail- 
able are unlikely to have or. be motivated to acquire the knowledge riecessary to 
do an effective job of disseminating the product. Similarly, the service required 
by the product also influences channel decisions. If the product requires 
servicing by technically trained personnel, intermedd^aries are typically not 
used because they are unlikely to J,e able to perform the service function 
e'ffectively. Products which arS" highly perishable are also likely to be distri- 
buted through special intermediaries. Educational innovations may be perishable 
In the sense that tbeir value is diminished if they are not distributed rapidly. 
.Finally, the unit va^ue of the product influences selection of a channel of 
distribution. If the unit value of a product is low, direct dist^bution may be 
impractical since it will probably . increase the cost of the product substantially 
(direct distribution is typically more costly than going through interlnedlarles) . 

The Impact of Characteristics of the Market on Channel Decisions . Two 
characteristics of the market, the extent and' concentration of demand, and 
consumers' buying patterns, influence the selection of a chant of distribution. 
If'demand is extensive an^ concentrated in a particular area, a producer may 
- find it worthwhile to use a direct channel of distribution and gain the 

benefits of having well-trained, specialized representatives. On the other 
• • • • ^ 

O'md, when^dcmand Is less extensive and geogrnphically dispersed, intermediaries 
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are likely to result lit more efficient distribution. The buyi-ng patterns of the 
target* must alsx) be considered in making the clknnel decision. When purchases 
are sma^l and frequent, indirect c^iannels of distribut'ioa are ty^cally used. 

, The Impact of Characteristics of the Produc er on Channel .Decisions^ 
Finally, two attributes of the producer or developing organization affect 
chant^l decisions, (1) size and resources of the producer and (2) brea^ 
of product line of the producer. If the producer is large and has substantial 
experience wlt;h the target market and the innovation, then direct distribution 
may be attractive. Thus, a large organization which specializes in 
educational products may find it worthwhile to maintain its own sales force. 
On the other hand, a small organizaAon ^and/or one which has little expertise 
with educational products may wish to use an indirect channel. Similarly, 
If an organization has a broad product line across which the costs of direct 
distribution can be spread, it^may be more practical to maintain a direct 
channel of distribution than if it produces relatively few products. 

Managing the Channel of Distribution . A channel of distribution 1$ a 
loose coalition of organizations tffat through cooperation sefek t> move goods 
to ultimate users. .While these organizations share the common goal of moving 
goods to users, they also have separate goals which may work against achieve- 
ment of the common goal. Specifically, while organizations conc&ned with 
,the diffusion of educational innovations, such as laboratories (e.g., Far 
West), REA's, and SEA's, may share the common goal of moving educational 
innovations to users, they also may have conflicting goals. In fact, thes 
organizations may be, competing for fu^ds, power, and prestige in the educatio 
arena. H6w, /then, can ttese organizations be motivatW to cooperative 
Insure the eflTClent movement of educational innovations to the ultimate 
user? • '•■ ' • • • 
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Several strategies may be employed to increase the efficiency of _ the 
. channel of distribution. First, It may be appropriate to Identify a "channel 
captain" of an .organization which will be the driving force :behind the 
channel of distribution. In an education setting NIE might play the role of 
the channel captain. It Is Important that the channel captain's primary . 
objective be the efficient movement of goods to the user. The chaonel captain 
may then attempt to structure the channel of distribution- and the rewaC^s in ' 
the channel of distribution so that other channel members focus on ' this common 
objective, rather than their own organizational objectives. ' ^ 

Tp facilitate cooperation ^in the channel of distribution, the channel 
captain may attempt to Implement specific policies designed to reduce or 
resolve dlfferences^etween channel members. For example, an exchange cf ' 
persons strategy might be Instltutedjt Under such a strategy, sehlor personnel' 
from one organlzatfon- In the channel spend time working In an organization 
at another level In the channel. Thus, an administrator from an REA might 
epeQd six months working In a laboratory such as Far West, and vice-versa. 
This would enable the channel members to better appreciate each X)ther's 
problems and goals and thereby would reduce conflict to a acre functional 
level. Another strategy which might be employed is 'etttabtldhment of 
^ mediation procedure to^ resolve differences which do arise between channel » 
members. Mediation helps resolve conflict since, channel Tnertbers make 
concessloas to a mediator rather than to each other. . ' . 

Finally, effective management of the' channel of distf ibuCion requires 
that the channel captain institute feedback procedures .In the dhannel. 
Consumer needs are constantly changing and channel members, particularly 
those who are In direct contact with the consumer, should be -trained to 
jonltor and feedback Information about. such changtf^ The channel captain 
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<VBy regularly survey members of the channel to facilitate such feedback. 
Sub-yksk: Promotion 

Promotion activities are generally formula t«dS«a^product, price, 
and distribution strategies have been established. The major functJ.on.of 
promotion is to provide potential users of educational, products with the 
information needed to make informed choices. Three vehicles are available 
!to perform this function: advertising, persd^l Celling, and .publicity. 
Advertising is any paid form of non-personal communication disseminated by 
an Identified sponsor. In the -educational context, advertising involves 

5 the, use of trade journals and direct mailings. Personal selling entails 

" y 

(contacting parties to the adoption and implementation process directly and j 

Informing them about the 'product* s attributes. Verbal presentations as 

well as actual product- demonstrations may be used for this purpose. Pub;ilcity 

is a non-paid 'for form of promotion which Is disseminated by various media 

because It Is newsworthy and Interesting to the\medla*s audiences.^ 

^ A critical task In. developing a promotional strategy InvolvesNcoordlnatlng 

advertising, personal selling, and publicity. To this end, It Is us^ul to 

develop promorfilonal objectives before making decisions pertaining to how 

promotional tasks will be achieved. Indeed, the statement of a precise set 

of promotional objective's Is plvotol to developing effective promotional 

approaches; It guides the selection of promotional vehicles, the communication 

content, and the Indices for measu/lng advertising ef fectlve.ness. 
^ : 7 ' 

> Statement of Objectives . A first step In developing promotion Is to 

articulate a precise set of objectives.' Promotional objectives typically^ 
* • consist of four components^ , ♦ . * 

1^ Market Target . The various^ publics and their relative Importance 

* *• . 

ERJC ' mus^e specified. We have discussed ho]|ghis task may be performed 

# when we examined sesincntatlon strategies. \^ 



Communlcat: 



be stated 



on Task* Under this^heading, a statement of ^he product 



attributes you wish to convey \to each target is specified. 'Identi- 
flcation o^: this aspect of the promotional objective emerges from 
the needs assessment discussed earlier* ] , ' 

Desired Change. What effect or result is desired in response to 



the 'promotional activity should be stated^ The desired change may 



r 



in terms of communication indices, such as awareness of 
the produc:t, attitude toward the product^ ^and intention to adopt 
It, or Ini terms of actual- adoption and implementation. 

The selection of the appropriate change index depends on two 
factors. One is- the .product* s stage ,in its life cycle. More 
speclficaliy, when the product is initially disseminated focus may 
center on achieving product awareness and ^ favorable disposition 
toward the producj. In later stages of the product* s life cycle, 
the rat>e* of adoption is lijcely to be the main criterion in developing 

the desired change objective, 

i / 

The oth^r factor to consider in establishing the desired change 
objective is the promotional vehicle used. For most educational 
products, the role of advertising (whether it entails placing 
space in trade journals" or direct mailings) . and .publicity is to make 
people aware of the product and provide information wh^xn enables a 



judgment of its appropriateness for them. In contrast, personal 

/ 

.selling is usually intended to stimulate trial. 

It should be noted that none of the promotional vehicles arc 
conceived as being suffii^^enit Jto indupe ad^option^ Indeed, this is 
the task of the product. Rather, promotion is seen as stimulus which 
facilitates the adoption and implementation of those products which 
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natch educators' needs. By the same token, promotion may serve to • 
speed the demise of unneeded products. 
4, Tiroe Period > The final component of a comprehensive promotional 
objective Is a statement of* the planning horizon. specifying the 
length of time it will take' to achieve the desired change among 
the various targets, the education^^ planner indicates when the 
^ promotional program should be evaluated. Although the time periods 




for promotional activities are freqdentl^ revie^jed^n an annual 
basis, such an arbitrary planning^h^^oA is not ai<JJys~appropriate. 
To this point, we have focused on the copfiponents of objective^ and 
the information .that constitutes the basis for .establishing promotional 
objectives. This discussion is sucimarized in the first, two columns in 
Exhibit 8. As we noted earlier, a statement of objectives is pivotal in 
developing promotional strategies. In effect, it entails coordinating 
knowledge of the market |pnd product and using this information to establish 
a precise set of goals. In turn, objectives are the foundation on which 
* executions of promotional activities are developed. ^ 
, Media Serlection . Consider^jthe media selection decision first. As 
Exhibit 3 s)\ows, one important input to the media selection decision Is the 
dcsirod change. If tHmUgsired change is in awareness of the product or a 
favorable disposition toward the product, then this suggests two promotional ^ 
instruments: advertising and publicity. The advertising options typically 
most useful in disseminating educational products are educational journals 
and direct mail. PublJLcity is often an effective device, sir^ce unli\e 
advertising it is presented by a source who stands little to gain by the 
presentation of information. Although publicity in newspapers, magazines, and 
professional journals requires no expenditure for the space, it does require 
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nts and Their ilxecutlon 
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' Objective 



Segmentation Analysis 



Needs Assessment. 



'Stage of Product 
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Objectives 
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Execution of ' 
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^Content of 
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active solicitation of the various meS^ia by the educational tnarket 
'necessary to demonstrate to the media why a feature on an educational proVj 
will be of interest to their readers. ' 'l^^V^ 

In situations where focus -centers, on achieving intention to implement and 

actual trial of the educational product, personal selling is the most appropriat 

' ' \ 

promotional vehicle. This may entail having salespeople explain the Use of t^e 

product as well as having demonstration sites to permit Vo^^^ct^ trial .\ The 

' A 

lattfer vehicle is particuarly important when adoption and implementation Involve 
a large financial expenditure in personnel and /or , equipment . ^ As noted eatlier, 
permitting trial with limited commitment enables those responsible for adopting 
and implementing a product to convince themselves of its utility./ 

Jy specifying the change desired, deci^^ions can be made regarding the 
resources to be allocated to professional journals, direct mail |)ubllcity, per- 
sonal selling, and demonstration sites. It does not, however, pe^rSlt a' precise ' 
determination of the vehicles to be used. For example, given an objective o'f 
creating awareness, it^ight' be decided to speyid one-third of ;the* marketing 
budget' against advertising. The question is: should trfis, be achieved -by using 
journal advert^^sing,' dirept. mail, or both? And, if journals are appropriate, * 
which journalf|^hoiil4 be>;s^^^ed? 

1^0^ address tli9s^issu4^ T^quires a consider^i^n of the target objective. . 
If the target is compfisj^d* of ^a large number of people who ,are similar in 
some respect (e.g., teachers)', ^tilt is often most efficient' (in terras of 
cost- per reaching ed'ch pe^on^ tp tise journals. On the other hand, if the 
target group is limited Tn si»i5;e anp h^terogenebus in nature, then direct 



mail Is likely to be the vmxyffi^ieqit means .of disseminating information. 
It permits tailoring'^ the a^eal to the specific target with" a. minimum of* 
wasted media cove|ase of tho^e unllkely ^'to .influence the buying decision. A 
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knowledge of the target is^also useful in choosing between different advertising 
vehicles* If, for example, superintendents are to be reached, then those 
journals that have a disproportionately high superintendent readership per dollar 
spent in advertHsitig would be selected* In essence, the attempt is to match the 
target to be reached with those vehicles which attract high target readership* 

Communication Content , The selecliion of fche appropriate communication 
content is bas<*d^ost directly on the communication task* . In turn the 
communication task is determined by a knowledge of what consumers want, 

r 

what product feat^ires you can deliver, and what alternatives are currently 
available. - 

A second factor that contributes to the communication content decision 



is the change desired* When an educational product is launched, the initial 
objective is to achieve awareness. In this situation, it is appropriate 
to provide^limited information about all major product attributes* 

An Important aspect of the communication content decisioj^s to insure 
coordination in various media. This is not to say that the same information 

, should necessarily be conmiunicatedin advertising, direct mailioga, and 
personal selling. In fact, as we noted earlier, these^ media for information 
dissemination may be suitable for presenting different types of Information* 
Rather, an attempt should be made to insure that Che different media are 
used in complementary ways - advertising to make people aware and favorably 
disposed, and personal selling to convert favorable disposition into trial* 
MeafiurinR Promotional Ef fectiveness > This task should be performed on 
a continuing basis starting before a product is launched* Pretesting 
promotions involves a rather minor expenditure before a heavy investment Is ^ 
made in product dissemination. Pretest may entail insuring that the attributes^ 

•discussed in promotional materials are important to information recipients , 
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that the information conveyed Is understood, and that it motivates interest. 
The monitoring activity should continue .after the product is launchcfl. 
. Thlff involves tracking demand for the product over time. Of equal concern 
is the ge^i^ration of data which provide insights as to the reasons for the 
level of. demand obs-erved. Specif ically._ surveys of people's product awareness,^ 
• disposition toward the product, intention to try it, should be conducted and ^ 
the rate of inqbiries generated by various promotional devices should be measured. 
These data not only indicate why a product'has generated a certain level of 
demand, they provide a starting point for developing strategies^to rectify 
thit facilitate product dissemination. For example, if awareness is poor 
this may suggest the need £or adjustments in media used and/or the need to 
increase sales' calls and advertising exposures. In contrast, if awareness 
■ is substantial, but people are not favorably disposed to the product, then 
^ the attributes stressed in the communications are likely to require 

adjustment. These -and other implications derived from measuring advertising 
effectiveness are illustrated in Exhibit 9. ' 

- Although we have focused on measuring the effectiveness of promotional 
* strategies, this analysis may be extended,to monitor the impact of product, 

channel, and price strategies as well. For example, high product -awareness 
. and trial but an unfavorable attitude toward the product.and little adoption^ 
. suggest that prodi^ct modifications may be necessary, whereas high awareness.-- , 
awareness, preference^ and trial but little , adoption suggest distribution • 
Inadequacies. ' ' , ' 

' orchestrating Marketing Tasks 
V > To this point, we have exafmined each marketing task separately. Effective 

^JwEfetlng strategy requires a -coordination of product,' price, channel -*«d-^^ 
promotion strategies. Orchestration of these marketing mix elements and the 
dollar allocation to feach is dependent on consumers' response to various 
ERJC Woducts in the educational marketer's~portfolio . We *hall Identify several 



of the most connon situations facing the marketing decision maker, and 
suggest the' appropriate strategic response' for each situation. ' ' 

Product Introduction Phase. In the early stages of product dissemin- 
ation, investment spending is typically required against all marketing 
. tasks. In relation to the revenue generated from product dissemination, 
the expenditures incurred in the product introduction phase are high. 
Indeed, financial losses are oft^h incurred in this phase. ' Expenditui^cs 
required to identify the market, to engage in product development work, 
*o promote an educational product and to distribute the product are 
• considerable, while demand for the product is low. 

Grototh Phase . If market analysis has been accurate, the. investment 
expenditure during product introduction results' in a rapid accelera^tion in 
pro^iuitjiemand^ To ^nhance this demand during' the growth pAase, investment 
spending is typical.-^ However, the investment Spending undertaken in growth 
differs from. that employed during introduction. Whereas introductory 
investment* expenditures are heavily allocated against market analysis 
product development, distribution and promotion, investment spending during"^ 
the growth phase are often irfore heavily allocated against price and distri- 
.bution. Furthermore, the rapid increase in demand, characteri-stic of the" 
growth phase, results iiv a positive 'return, on the marketing investment. 

Maturity Phase. Once* demand for 4 product has stablllaed, in the 
maturity phase, several strategies<are- available tq the educational .marketer. 
One entpils maintenance spending. Using this approach, enough funds are 
allocated to the 'marketing effort to sustain'product demand at its present' 
level. Alternatively, a harvest strategy mav be employed. This entails 
reducing the m&rketing expenditure for a product in order to Increase the 
cash flow. Use of a harvest strategy is predicated, on the Msumptljon that 
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the decline 'in demand resulting from a ye^duction in the marketing budget 
Wiir be more than offset by the budget sa;wings'. The^lncrease Ulf cash 
flow which results can then ^Invested in new product opportunities. 
A harvesting^stta^e^f is particularly, appropriate when. the educational^ • 
product p'roducer. has a substantial number o'f loyal re^^hasers. In" 
this situation, the reduction in nferketing effort is'^ unlikely 'to result -in 
'a comparable ■tfeclJLne in patronage. - ^ ' , 

^ - In the maturity phase of educational products, ^fr-inay be Useful. to 
fpcus on those institutions that hive limited financial capability for 
^ew product acquisition. In marketing to this target, the price of the 
product may be lowered to^act His ^e^ment. Alterh»ti.vely, ^product 
improvements may be institutedtnd price maintained if tiore financially- 
ab'le targets .are. being considered. — ^ 

Decline Phase . In the decline stage, when demand for a product , is ^ 
declining, the educational marketer should consider an abar^nment 
^rategy. This entails withdrawing marketing support frap 5 product; 
advertising 4s withdrawn and price may be incneased. Abandonment is 
appropriate when' it is anticipated that the dollar allocation^toward 
Tketing activities will be grea|e?: than tiJ revenue generated from 
product sales. If the product demand »ntinues to decline when inarketing 
suppqrjt is retracted, it should become '^J^aiididate for dropping. 



III. MATRIX ORGANIZATION AND. THE R&D PROCESS 
• so far the marketing organization has been descrfbed In terma of its con- 
' stituent task flow processes. The major feature of the marketing design is th 
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way in which the R&D process Is embedded In the organization to make it maxi- 
amlly responsive to the user. This embedded structure takes two forms1^,Flrst , 

the R&D process is placed between the market analysis process and the strategic^ 

«»• ' % • 

marketing process. Products do not originate with the R&D process so'much as 
pass through it. Secdnd, the R&D process fs further embedded within the stra- 
^^^^^glc marketing process itself. It 'becomes a part of the new product develop- 
ment task in order to ensure feedbackrf rqm the target segment. 

^ For a complete description of a marketing design, however, it is also 
necessary to consider the relationship of personnel to these processes. 
After a history of considerable^ experimentation in the private sector, it 
Is now widely accepted „that the ^est form of personnel Structure for the 
marketing approach is the matrix org^anization. In its most; general fo<rm 
the matrix organization represents a trade off between centrfklized (tall*) 



and decentralized (fUt^ organizations. In the matrix organization, ^project 
'coor^nators functioWTike the heads of decentralized departments/ They 
attempt to. m^tke sure that all decisions take accoujnt of the particular 
requirements o'f their project. But they also. draw upon the centralized ' 
resources of a group of experts in making their decisions. 

Exhibit 10 displays a matrix organizational structure which is very 
commjbn in marketing. This structure is generally termed a "product manager" 
organization. While ultimate responsibility rests with .a marketing executive, 
the da3\to day responsibility for products is decentralized to individual 
managers.' If there are a large number of products, nxyt oixly is there a 
manager for eacfi .one, but related groups of products have managers, and there 
may be an overall divisional product manager as well. In contrast to this 



deccntraliz^tioa, there also exists a group of experts centralized at the 
division level to perform key tasUs. ""Usually thcsie tasks arq those relating 
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to marketing research^ promotion^ and distribution*. The product manager has 
^responsibility for the remaining tasks and, more importantly, for integrating 
tKe work of the centralized specialises to ensure the best product possible. 
It*would be expGcted that a marketing approach to educational products 

\ 

* would make use of such product manager design. But the*mo5t Important 

implication of the matrix structure is for connecting the R&D process to the 
marketing processes which itf is embedded/ The product- manager is the 
natutal vehicle for ens^^ng that marketing tasks do flow into the R&D , 
process as prescribed. Jo do this the product manager must use not onl 
marketing personnel as centralized specialists but R&D personnel as well! 
As portrayed in Exhibit 11 the product manager overlaps with both market^n| 
specialists and R&D specialists. His role is. to form a link through whl^h^ 

, the marketing tasks we have described can *be related to R&D activities. 
The marketing design proposed here would employ product managers as 
t;he linking pins with which to embed the- R&D process in the organization. ^' 

Resources > Not Boundaries 

The proposed marketing design has purposely been^ lef t ambiguous in one 
important respect. The design could apply to a specific organization, such 
as an existing Regional Laboratory^ or it could apply to the entire system 
of R&D activities, or to some portion thereof. Consideration of these 
possibilities is beyond the scope. of. this paper. It should be pointed 'Out, 
however, that the general design proposed is in principle neutral to 
organizational boundaries. The design has been p1:escnted in terms of tasks 
and personnel relations. Tliese may be placed within specific organizational 
boundaries in a wide variety of ways. But the overall design principles are 
not ^altered by these boundaries. It does not matter whether thd market- 
analysis process and the marketing research specialists associated with it 



ERIC ^ 58 



Exhibit 11 



Karketiag 
Research 
HaaQger 



Promotion 
Manager 



Murjcctlna 

Executive 




i ' Product 
I Mftrketln^ 
i Manage 



f Managera 



t IlndiViduai: 
I Product 
I Managua 



.Product Manager Organizational Structure. 



59 



- 47 - 



are housed institutionally together with the R&D process. This is not to say 

that problem^ may not be encountered with institutional Reparation, as with, 
* ♦ 

for example', the authority of the product manager. It is jiist that the general 

* 

mafketing^design still applies. * . , 

More relevant than .the question of organizational boundaries is that of 
resource allocation* It should be clear ""that implementation of the marketing 
design proposed here would require a massive restructuring of the resources 
available for educational products. Funds would have to be shifted away from 
R&D per se intp J:he ma^rketing task^. It is this reallocation of resources 
rather than the problem of organizational boundaries that would prove most 
difficult in implementing the marketing approach, - ' . - 

, ' * SUMMARY , \ \/ 

In this paper, we have outlined a* marketing approach to the development 
and dissemitiation of educational products. The implementation of a marketing 
approach entails focusing on the needs of potential product users as a basis ^ 
for product development and dissemination. Thus, the marketing approach is 
user-driven. On the basis of research pertaining to user behavior, homogeneous 
markets can be identified, and product ,'-^rice, channel and promotional strategies 
can be developed to satisfy educators* needs. In order to implement the marketing 
approach successfully, a matrix organization is suggested. This organizational 
design ensures coordination between the R&D process and the marketing process 
in which it is embedded, * 5 " . ' 
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INTROD^JCTION 

The centifal theme of this gaper is, balance ^ Based both on *a review 
of what models- of knowledge'production and utilization (KPU) have to tell 
us. and on what operational elements we §ee within the R&R Exchange's 
initial design, we will argue tliat maximum impact and utility of the RDx 
effort can be achieved only if there is, a balance between the needs and ^ 
interests of potential clients on one hand, and the. services provided by 
RDx on the other. Balance also means the sharing of power, inputs to the 
-effort (informational and procedural), and responsibility or outcomes. 

It is hard tp disagree with so basic a statement of ^he issue, yet^ 
we wilTsee below that there are some important areas in va^ich the RDx 
design is already out of balance. This has happened . chief ly because the 
effort was designed- more by information providers than by potential clients 
and because the conceptual ajfproaches of the designers of any KPU effort 
are important forces in shaping what the effort will become. \ 

,We will approach the issue of balance in two ways: first, we will 
' discuss the iconceptiaal approaches to KPU, concent,rating on the assumptions 

•V 

behind them. An" expanded "linkage" model will be used to synthesize 
earlier "pplar" .approaches , and to explore forces which underlie or pre- 
diet linkage*^ Second, we will analyze RDx using the concepts and criteria 
elaborated, to arrive at a series of problems and recommendations. 
CONCEPTUAL APPROACHES 

V - How an in'dividual views the KPU process asually depends on where 
that individual is in the process. Knowledge producers, linkers, and 
^potential or actual clients tend. to see it in different ways, emphasizing 
parts of the process or using different analytical bases resulting f rom^ 

o <' • . ' ' C ' " 



their ^fferent backgrounds,, p6sltlons, and most of all,¥ needs and in- 
terests. \When a field attempts to* build a large and carefully-planned 
KPU effort, tnere isf' alwajfS^^e danger that the- effort wil^ take on the 
character of the conceptual approach, of its desigpfers; and it is- almost 
always the cajse that KPU efforts are seen as neede^d^-agd ape designed by 
information producers or intermediaries > The reasons are simply that 
producers and interctediaries are rewarded based on th6 extfent to which 
their products ate disseminated, recognized, and (increasingly ^in recent 
years) put to use. One must always ask v?hose conceptual^ approaches are 
rapresented'Tir^the design qf a KPU effort, and what assumptions these 
approache^^ contain. The aim snould he to design a KPU effort from a con- 
ceptual approach which is shared by both the producer and potential user, 
but this ^ is di^fficult in large-scale efforts where producers,, intennediaries 
and clients are separated by great distances of space and time. Most par- 
ticularly, it is difficult to achieve a shared approach where there is no 
direct .interaction from the very b&ginninj» among these three^ groups. 

^ Input from the potential client is .often lacking because: (1) clients' 
concents are most oft^n with their own products and outputs, not with poten- 
tial inputs (particularly if these inputs are abstract or need localizing); 

• o 

(2) clients are usually scattered around the map, unoganized^ and are ^o 
large a group that even could they be b.rdught into helping with the de- 
sign, thej^wbuld either overwhelm the process *or be so diverse that they 
could not come to a consensus among themselves. Hence*, we have seen^the 
rise of "need-sensing" methods and. efforts, whose goal is to survey the 
problems, needs and capabiTities, of poj:ential clients. T?hese approaches 
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usually contain two flaws^ however: (1) they rarely survey the basic con- 
ceptual approaches clients hold about the KPU problem; and (2) they almost 
always begin with needs for information and not^brpader need^ (and only by 
a comparison with informational vs, other^^eds can we determine the 
perceived impo|:tancc of information, or ^f that subset bas€?d on R&D on 
Yllich most KPU efforts are based). 

As we will see later when we take a detailed look at the RDx design, 
the designers- are not clients, nor are many clients represented directly in 

the ^process. Further, the effort, by its very name and in the emphasis it 

\ ^ 

puts on input and service functions,' is geared primarily to the^ R&D subset 

H , ' . * 

of information, and certainly to' information' as contrasted to other pos- 

l^ble kinds of "solutions." ^ 

The "Polar" Conceptual- Approaches; "R,D&D" vs. "Problem-Solver " 

' • \ ; \ 

llo^t KPU efforts attempt to balance two different views of Jhe KPU 

process: that of. the producer and that of the potential client. As Havelock 

(1969) fategorized ithem, these -will be called the "Research,- Development, 

and Diffusion" (R,D&D) and "Problem-Sblver" appro^chesj respectively • The 

first is -concerned primarily (though not exclusively) with djyeloping uses 

for know^dge coming from /the R&D process. The second Is' concerned primarily 

with getting help^ for FJj^ctitioners in solving real problefes (note that ^ 

* - ♦ , * ^ 

•we do not say 'lisers, "^since this term is an already bl.aded view of the 

roj(e of thi^ group^ . ' ^ 

. The*R,D&D approach concentrates on describin'g the successive stages - 

.^of^ activity involved in the basically, "lirtear" (/though of ten .recycling) 

process through which knowledge derived from research is taken through 

developtoerrtal testing'and into ^marketing' or diffusion activities designed 

to "sell" pr a'chieve uses for that knowledge. The approach assumes % 



that the process is and should be staged, rational and logical , and that 
the users of outputs, are themselves "rational-logical*" .A key assumptipn 

here is\hat, howe^^r t^ie ultimate ptod^ct is derived (either flowing) 

/ ' . ''^^^^ 

directly rro-a research* discovery or ai the result of applied reisearch based 

on need statements) , empirical operations and research expertise arc required 
to come'up with a product. The concentration is often on planned, lar^e- 
Scale efforts, and on "top-down" direction and flow of products and influ- 
ence. This is a centralized notion of control ameiaable to program devel- 
opers. For our purposes, however, the most futidamental assumption of the 
•R',D&D approach whj.ch we question seriously in relation to RDx is that it 
is possible to design a truly effective effort through systematic arrange- 
ment of organizational-level components, without the direct participation 
t)f the potential client in each step* 

' • ( • 

On the opposite pole is the *^Problem-Solver" approach, .whicp begins 
with. a^elt Reed in some practioner (non-researcher) groups or wfth the * 
derivation of needs as the result of some intervention or change«^agent 
activity* The focus is on finding the best solution to the need, regard- 
less of its source or form* The process through which the client groXjp 
is ^aken is ^as important as the substance of the pactlculflr solution, « ' 

because of the problem-solving process learning essuflitd .^/take place* 

One way, to contrast these^two approaches id to c^slder what is "fixed" 
and what is "free to vary" in each. In the R,D&D approach, empirical knowl- 
edge is the given or fixed component, «and potential applications are more 
or less open. In the Problem-Solver approach the need Is fixed, and the 
potential solutions are open. Tl>e crucial issue « is the relevance of 
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R&P for client needs — ^ KPU efforts often assume too iincritically that in- 
formation is the best solution, while clients most often view information 
as having less inmediate" benefit or payoff than other kinds of solutions 
(e.g., manpower, funds, support, legislation, innoN^ative practices^. etc.>^ 

Ultimately, neither of these approaches^is a complete modej. of 'the 
KPU process. The ^,D£tD approach stresses the ^*KP" at the expense of what" • 
we know from organizational change and development regarding the "U" or ^ 
utilization process; the Problem-Solver approach looks for solutions with- 
out too jni\h "regard for developing capacities outside of the practitioner 
organization which can help that or other organizations in the future. 
Linkage; A Synthesis ^ ' 

^he concept of "linkage" deals with relationships between a resourjce 
person or group and a practitioner or practice ,org^fc|at ion which con - 

aubusly facilitates and%rqmotes mutual inf ormg^^B^^ctrange and helping 
activities with respect to' significant practice neiSs . fiach underlined term 
is important. "Continuously" highlights the need for more than one-shot o^ 
fleeting phenomena; "mutual" stresses the dialog component and opportunity 
for* impacts on both producers and'rlientSi plus the notion ^of openness and 
active relationships; "helping" involves' a commitment and involvement, and 
the notion of evaluation of activities tcJ see if they really do help; "needs' 
stre^^ses again that the focus of the linkage i^ on the resolution of needs 
.(not on the delivery of some product). . . 

Linkages may take on the character of ideals the 'KPU effort woold like 
to achieve. To facilitate linkages we need to know more than what they 
are — we need a sense of what predicts or leads to .their, establishment. . 
The model* wd have developed organizes predictor forces by levels: 



Societal ; direct- effects' of laws, &.upports, social climate * 
and the evolution of social issues, econoniic pressures, etc*. 

Organizational ; leadership, goal definition and decision- 
' - r.aking processes, skills , Rapacities , participation, C^ywrd 

systems. ' • ' . .\ ^ 

\Indivi£U3l: attitudes about'change, risk, etc. , ^training, ^ 
skills, knowledge, role clarity, and power.. ; 'j 

rocedural: between situation and linkage media, .-re<iun- 
ancyr, capacity, and fidelity of channels, * ' * x 

'Content : connunicabilitiy of the messages (botb needs and' . * 

solutions), innoyation^organization fit for clients; the * ^ 

fit of needs with. R&D and service prograa-^laos and c>pa- ^* 

cities for solution providers^ ^/ x , ' " 

Me need toVio nore than the current tren^" in KPU theory of * listing pre- 

/ ^ * * . • • , 

dic^ir factors, however. These forces act ih one of four ways: (1) affect- 

I, ; * 

ing both linkage partners equally; (2) a^fpcting either or both "linkage pajt; 

ners, but ^^parately ; (3) 'affecting both through their similarity on the • 

factor; and {%) affecting both through' their*compatibility on one or a aet 

^of factors. • (A more detailed treatment and statistlcal^^iodel arc given ia 

an appendix to our complete paper.)- , " ^ ""^^ 

In summary, KPU approaches> must be evaluated regarding their aasump- 

■ ' ' - . . i 

tions, and *must be related to RDx to deteifminc: (l)*fehe kin48 qf^ apiQroaches , 
used in the 'planning of sRDx, (2) the suitability of a particular approach ^ 

^ to the effort, and (3) suggestions regarding directiona RDx might want to 

• ' ' ' f 

explore coming from these approaches, particularly from the syntheses s)ig- 
.^e§ted by more recent writings on KPU models. ^ ^ ^ /- . " 

LOOKING AT RDx FROM THE KPU MODELS ' ^ ^ ^ > 

In our complete paper w^jj^Lescribe RDx through use of eight *'oper,atio^l 
modes" (Havelock, 1974; Havelock and Lingwood^ 1973). l^hese oKtaes are 
nore concrete elaborations of the perspefcti^es represented in the k,6&D, 




Problem-Solve^fa^TLitikage approaches. Below we provide ^ brief descrip- 

) •> 
tion of e<ich mod6, where 'RDx' is in relation to that mode (as taken from 



our knowledge of RDx and- from the draft RDx solicitation; NIE", 1977), and 
our reaction based on {cnowledge of €oth KPU theory and RD:C planning. The 
modes arej^-presented in a sequences based on increasing levels' of client 

. , f 

inx^olvement or **client-orientation. " 

. "Natural-Network Nurture" 

_ Elements; KPU functions are added to information flows taking 'place* i 
existi;^ networki': prof essiopal .interest groups, "invisible colleges, 
.^etc. Spe^iial KPU activities aj:e funded in this contexts 

RDx Plan§ ; "The' R&D Exchange will concentrate on strengthening , 
these cKanneJLs ^nd making sure that' high-quality R&D outcomes and 
exemplary practices are available." . ^ 

Predictiva Factors ; There are likely to be several different and 
poorly interconnected networks (e»g., among p2;pducers and among 
practitioners). Group-centered factors, rewards, skills, and values 
limit iriterconnections. 

Comment ; This mode is subject , to what i's available in terms Vf 
existing networks, and these tend to be stratified 'into practitioner 
and R&D neti^orks with lititle linkage between the two. This is a 
very "laissez faiire " approach ^o KPU. It ^s important to identify , 
practitiOit^^r^and R&D infprmal networks, since tmese are powerful 
shapeYs of itonsensus, -and are informatio£^spu4M!es, highly trusted^ 
bytheir members. However, major^KPU goals are not likely to be 
achieved only by making inputs into these networks* 'If they are 
seen as powerful linkage forces. We must ask why they have not 
already done^tlje job? It is important, however, to strengthen ' 
practitioner: networks, and state-to-rst^ate information and resource 
exchanges are helpful here. This can help re-balance power in RDx, 
giving a centi^alized and coordinated voice for practitioners to 
^ack up feedforward (need) information. , ' . ' 

/Continuous Flow Dissenfination" ' 



\ 



El^nients;' This is a partial mode j^overing dissemination of * * 
printed materials of Jjwo types; popularized serial publications 
which bridge between* R&D jou:rnals and non-*researcher audiences, 
and selective dissemination of information, in which printed 
materials are matched to reader interest and need profiles. 

RDx Plans ; -Operations Support ^±11 be involved in publicity, 
and special^ publications and newsletters are planned. and may be 
tar^etted based on user' needs , and interests. , 



Predictive Factors : Given Che low chance f or^eciprocity in , * * 
this mode, factors affecting producers are not' likely to be 
changed'by these activities, and thus, the knowledge base i^ not 
likely to> be altered much over time. ^ This is, then, not truly a 
linkage. " , * , * / 

t _ 

Xozizent ; RDx is not oriented ^to mass audiences, and so this mode 
is best used for general awareness, publicity, and to cast a weak 
,.but broad net which may catch a few new people. 'RDx does have a 
role to play in serving as a broker for practitioners, sireejning- 
and reccrziending the best of the many popularized and SDI publjlca- 
tions available. ^ 

"R&D Product Dissemination Service" 

- Elements ; Here R^J) products are screened for quality by^ a central 
group, . transformed, ^hd disseminated "(also with demonstrations and 
consulting help on»>daptation and utilization). The focus is orf 
planned <tefcfesemination and utilization efforts to 'sell R&D products; 
and this depends on the availability of disable **R&D. Limited need-, 
"re-sensing" is done, to insur^ that 'needs still. equal those which 
' ' supposedly drove the creation o^f the R&D base initially. 

RDx f^lans : Several RDx activities fit in this mode. Operations 
Support will screen R&D for quality; R&D* Interpretations will > 
analyze* available productfe and transform them, especially ih high 
priority areas. Exc'panges and contractors will assist linkers in 
disseminating produces. Identification of information resources, 
'the regtonal R&D resource exchanges, adaptation and distribution^ 
of materials, etc. all fit in hdrd. • ^ , 

Predictive Factors : The most crucial .factors here aSfegt the 

• need-sensing component, since PvDx hfis been well dtesigped on the* 
solution-delivery side. Organizational capacities to deal with , 
competing need* stfatements will -be important (e.g., normatiye needs . 
determined by surveys, individualistic ones coming from the Ex- 
changes). At th^ procedi^ral level, the neeii-sens^n^ patbs in RDx 
are long and indirect. • ' ' . 

Cbozaant : "Tfie key to success in this mode is the combination of 
R&D product screening for quality given the context of .current 
needs of clients or target^s. R&D interpretations will ,do no 
direct nefed-sensing", .^nd »^y be somewhat isolated f^rom the needs > 
and uses^f the iij.tinate coasuirfer of its products.' Thus, th^ " 
Exch'ang^and Operations Suppo^ will have to be active tieed ^ 
pro'ceaiors, and this may^ be^ submerged in the press .of ^)ther. act- 
ivities aifd priorities. ^The primary linkeri^^clients may _ limit' ^ ^ 
' the ability of RDx to determine the needs bf the ultimate clients, 
educational practitioners. Multiple need-sensing paths^are^h^ded, 

♦ just as multiple delivei^;^ paths are requi»^c| €o build -in red'urxdaticy 
and error-checking* \* f . - 
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'^Instant Response R&D Retrieval Service" 

Elements : User Information needs are channeled through a "hotline 
service** to Information cmd_huraan resource data banks; output is 
tailored somewhat to meetVSthe user's situation and needs, a^nd is 
. returned to the requestor ty- mall or telephone. Answ^ to ques- 
'tions, asked frequently may be pre-packeged. Complicated or unusual 
requests need separate processing and additional .clarification of 
the user's needs. This approach depends on having an 'up to date 
and useful bank of R&D information^ and adequate human resource banks. 

RDx Plans : RDx does not wish to duplicate ERIC. operations, which 
are similar to this mode, but will provide assistance for clients 
in training and access to systems. * The Regional Cxcijangas vrttll do 
some of this, but in a more informal manner througtt the small reg- 
ional R&D resource centers they create. Many Labs Already have 
Mata based seareh capabilities. 

Predictive Factors ; This mode depends on the skill and knowledge 
of the initial point of contact, the "hotline" operator. Operators 
must have good need-sensing and probing skills, knowledge of the 
human and R&D reso'Src^ base's, etc. ^Capacities of human resources 
are also important- pi/edictors ; it is e^sy" to oyer-work those perjson^ ' 
who have'^iven good service iii*the past. - ^ ' ; 

Coaaent : This mode is a compromise ,6£ the notion of true client- 
orientation, since .the range of possible help is fixed to what novf"^ 
exists in information or resource banks, and the client has no ifeal 
ability to influence the contents of ^ither. This approach works 
where the scale can be kept small and on a person-to-persan basis, 
or where R&D has useful answers- to give. In the RDx case, scale 
can be controlled! by doing this at the regi6nal level, but' educat- ^ 

^ ional R&D and human resource banks will often fail to produce definl- 
•tive answers* In these' instances the service must be able to drop 

^ 'R&D information as its base and to switch jto providing skills which , ' 
may'be applied ^directly ^in helping solve clients' problems. 

"Rapid-ResDonse R&D' Report Service" * " 

Elements :^ This is similar to the mode above, but. wfth much more 
Tlepth and composition of responses. State-of-dhe~art reports are 
^ tailored for each ^:lient by "writer-experts.'' This level. of detail 
must be reserved for important issues which do not demand immediate 
responses in crisis situations, because of. the costs and* time*re- , 
quired to. respond* This mode works best in instances in 'which the 
olients have the power to. demand custom services/, as in the case 
* of the Congressional Research Service. ' * . * « 



RDx Plans : High pfiority« areas will be given this kind of ' aUten- 
tHon on the -review side, and (hopefully) almost as much on the 
tailoring side, by R&D^ Intjerp reflations. ' 
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Predicti ve Factors ; Client power is the key issue here. * In the 
, RDx case practitioner clients do not have this level of power, and 
.even linker clients may not, sinc^neith*er g,roup mandates the RDx 
effort itself. Policy-maker clients may be served in this mode by 
RD:v, however. If RDx tries to serve bot4v-pT5T3Lcy and practice it 
cay encounter capacity and role-conflict protflems^ 

Cor-=:ar,t; This mode provides^ the mosjr thoughtful and client-tailored 
coverage of the R&D base, but it is an expensive process. The size 

the potent'!^ audience makes ith^rd to .provide this level of ser- 
vice. ' It is, almost impossible t^^^eak the cost-he]jpf ulness equation 
which is at ,the,root of many KPIT p^roblems and efforts. There is also 
an issue of' how prioritfy areas will b^ "defined to require this in- 
da>th coverage.* V/hat is needed is a, process which will ^ive' clients 
the feeling that they have participated in defining, and hence have 
greater probabilities o'f using, these priority analyses. Again^ there 
, is little in this mode which will allow for impac^ on the educational, 
R&D data base itself. Th^is mode may be seen as a linkage between 
the t^r iters and •the client,- but not between clients and the original 
^ R&D or- solution-providing community.' Thu5, special attention should 
*be given in RDx to linking unmet needs and recommendations which come 
out of work in the priority areas back to the educational policy, 
, . program, and R&D-funding communities. 

"Coordinated Mission-Oriented R&D Programs" 

Elements ; In this mode the focus is on large-scale highly- visible - 
R&Di)rojeots geared to affecting policy, rather' than toward dissemi- 
nation io practitioners. Management and monitoring are done at high 
policy levels. Change results through administrative and legal en- . 
actment and/or enforcement. Great attention is given to quality and 
^ relevance of the R&D product since the stakes are usually high. Need 
sensing is assumed tc? have been done at the societal or political 
levels . 

RDx Plans ; "Not within the purvue of the'fe&D Exchanger?^ However, 
feedforward activities are designed to . link witlytfroad need-sensing, 
and the Regional ^Exchanges will collect, and cotkractors will p^rocess 
and report, needs data to R&D policy-makers. ^ 

Predict ive Factors ; RDx's role in passing needs along to other pro- 
grams operating in this mode is important here, even if RDx doe's not 
want to undertaice this work itself. ^Here RDx^wJLH ent«r an areaa 
populated by powerful .existing groups with vested. Interests in the 
shape of large-scale .projects (e.g., funders, researchers, other NIE 
programs such as plans for a need-sensing network, etc.) J RDx will 
"thus need a well thought out and demonstrably accurate need-sensing 
capacity, and the top-leve*l capacity to make 'linkages with, policy- 
makers. ^ / f 

Comment: We agree th^at RDx should not attempt to operate in this 
mode or become active in sweeping "social probletn oriented" R&D. 
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Yet, in.seicviijg as a tieecf-senser, £here is no clear path or planned 
linkage with those 'who do operate in this mode. 



"User-Centered R&D" 
« 

' Elements : One style in this mode is^"ad-hoc usei^ research services," 
^ in which'^lients sponsor R&D to meet, their own needs. Marketing and 
' organizational research are examples of this., A second style, "user 
4^ collaborative R&D,", brings clients iii.as fulL partners in the research 

^ , ' process. Action-research fits this second style, with clients active 
through all stages of t-he R&D* * I 

RDx Flags ; "Ac hoc R&D in response, to particular^ practitioner.'s 
requests cannot be part of the R&D Exchange." At the regional level 
tW Exchanges may serve as linkers between clients wishing to enter 
this mode and resources who rfiight 'help them. 

Fredlctive Factors : Reward systems of helpers or action-researchers 
are crucial in this mode (see Lingwood and Morris, 1976). An inter- 
disciplinary orientation, openness and personal linkage skills arf 
required of R&D personnel who attempt^ to work in this mode. 

Comment : Even if RDx does not work in this toode, -its broker role 
will be important. RDx might become involved in disseminating the 
results of such work, or with demonstration programs* Careful sel- 
ection of demonstration sites will be needed, asfggill close RDx links 
toR&D fundersj -to insure that researchers know they can use sites 
linked to RDx in their action-research. ' ' . nj; 



"Knowledge-Based Problem-Solving Consultation Service" 

V; 

Elements: Here clients' needs control interaction with an outside 
consultant, and there is no "unsolicited!* communication.^ R&D in- 
formation is only one of many resources to the consiiltant, and the 
' most fitting resource will be used, depending on the client's needs. 
The consultant also, helps with tTie prablem-solving prpcess the client 
uses. 

RDx Flans ; Regional Exchanges .will perform a f^w of these functions, 
with support from national contractors. The extent of involvement 
will not bre great, however. ^ ^ ^ 

' Predictive Factors ; (Consultants must have a wide range of skills 
and good linkages to knowledge and other resources inVoTis mode. 
The resource system must be able to support £he effoiit even if its 
mdst favored type of ^ salution (e.g., that based on R&D) is not u"^ed. 
Regional Exchanges will require high levels of skill fend capacity 
.in operating in thi-s mode. Also, the Exchanges/may h^ve to contend 
" ttwith need filtering or gatekeeping which-may occur at the "linker 
client" level, i»e., between the Exchanges and practitioners' real 
. needs. , . It 
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Comment; V/hile RDx will provide for identification of outside re- 
sources and experts who can work in this mode with clients, and may 
become involved here to a limited extent in such activities through 
tasks^ the Regipnal exchanges undertake, the effort is still based 
firaly in educational R&D, and this may limit the capacity, of RjJk 
to wdrk in, or even foster this mode. It will also be diffici^". 
to iiiaiiitain the R&D emphasis and acquire process and helping ^ilj.s 
at the sanie tise, particularly at the busy Regional Exchange Uvel. 
Skill and problem-solving procfess training are' optional services of 
the Exchanges, and we wonder how much of this will take place' given 
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inf onnacion. \. 
These operational modes may be seen as a developmental sequence, in 
the order we have presented them here, in many instances. KPU ^f forts 
tend to become more, open to client inputs as early attempts (usually 
base'd on^^^ existing R&D base) f^l to meet needs. Even in education, 
Che n^sh for need-sensing grew more than:t*a decade after the establiBh- 
nent of major dissemination activities such as ERIC. The simple sequenc- 
ing of these modes masks th£> fact that fewer cliebt organizations are in- 
volved in thfe most- client-centered modes. Many cljbent organiaitions drop 
out somewhere around the m:^dle, particularly if they ar^not innovative 

9 

e.nough, or lack imaginative* leadership, in relation to the issue of change, 
as a whole. Thus, from the producer's side, watching client groups falL 
away as^efforts move down the sequence, this ordering is probably not 
developmental. From the perspective of t;he client group which can stay 
with the sequence as it comes more un^er its control, howev^, there 
probably is a developmentfal procesS her.e first becoming open to .'inputs 
from out;side in the form of R&D information, next in seeing the gaps in 
the R&D base, and finally bringing empirical apt>roaches to change inside 
the organization for greater control and wider scope of the effort. 
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A SODLARY OF .BDx LINKAGE ACTIVITIES 
• '» 

l.Tier. we look at all of the activities through which RDx will make con- 
tact with jpractitioners and linkers, and compare these with the mechanisms 
through which these gr9ups can influence RDx and the' R'irD community, we 
see clearly that RDx is more of a delivery* system than a» complete linkage 
effort. There are multiple delivery paths, but very low redundancy in, and 
certainly much less exposition/ given to, the need-processing component. 

Furtheif, most of the ties to linker and practitioner clients occur 
through the Regional Exchanges. The Exchanges have many roles to fill in 
the overal| effort, bringing up the |fssue of potential overload. "Overload 
may also become' an issue for the linker clients of RDx. 

The level of client participation in planning and managing RDx seems 
too low,' from the standpoint' of producing commitment to knd feelings of 
"ownership" over the effort. More ^^ention to- need-processing will 
help overcome this, but RDx really should have begun with much greater 
input from the field, and this lack/ diay now be hard to overcome. RDx will 
also need to do a better job of deciding just who its clients are. There 
aij^ probably too few "linker" clients to justify the level of the IU)x 
effort, but there are definitely too many potential clients for the efforl: 
to handle if RDx opens* itself up to all educational practition|rs directly. 
Linkers may also -serve* td'filter out need statements from the f^eld. * 
A SUMMARY OF*-^X' AS SEEN^FROM THE "LINKAGE PREDIC TIVE" MODEL 

T' '* ^ i ' 1 ^ * 

Here aVe sdme of the major forces we see. operating on RDx, organized 

according to the leve^ls of linkage predictqrs discussed earlier^ 

Syietal :* The key her^e is the sacietal;push for KPU efforts in order . 
to achieve sone^payoff for the large social investment- in R&EK ^ Not;e 
that there is p^ot as vocal a push for R6J)-based solutions coming from 
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practitioners — they are contending with inflationary pressures, 
parents and voters who ate asking difficult questions, etc. Regional 
e;;changes niay be hard put to demonstrate tne relevance of Rfira-based 
solutions to harried educators or linkers Lho are more worried about 
siaple survival. The evaluation of RDx must also take this into 
'account. 

Organizational; Reward systems in academic R&Q appear to limit the 
potential contribution of many researchers in deriving useful solu- 
titins. Conversely, practitioner reward 'Systems stress operational* 
success^not information input ~ thus,' RDx will have to demonstrate 
to practitioners jthe direct benefits of in^naatlon Inputs on oper- 
ational performance* Cost-b^ef it data will be needed. 

Individual; Initial need-sensint steps ar^ needed with eaxih poten- 
tial client with which RDx's linker ^ients work. This builds the 
reciprocal inte;rpersonal relationships needed in linkage. Thus, RD;c 
»must be able to train linkers in relaticncil processes, and must be 
able to change itself in response to what linkers say is neede4« 
RDx must avoid the tendency to overload individuals in its human 
resource banks; Regional Exchanges, and linker client groups. 

Procedural : ^gional Exchange freedom in establishing linkages based 
/ on previous experiences is crucia^.. Supports are. needed to alldw 
the Exchange;5 to work through as many interpersonal channels as pbs- 
sible. On another level, there are no clear statements as to how 
will link to educational policy-makers, researchers, and other stake- 
holders these nead to be elaborated., c 

. Content ; Again, the key thing here is to keep RDx open to, .content 
odher than that based on R&D: practice innovations, sources of sup- 
port, referral services, etc., may prove- more useful to many clients 
^ than R&D-based knowledge. IJot only must this Variety be provided 

(or at least linked to, outside of RDx), but monitoring and evaluation 
must take continual* account of the utility of various kinds of solu- 
' tions. 

«^ 

RECO>OENDATIOXS 

As a conclusiorf, we propose thr.ee broad sets of recommendations de-* 
rived from the- analyses above. The first set pertains to the operating 
philosophy and image of RDx. The second relates to the oji'erational modes 
which might* be emphasized. The third relates to the process of system 
monitoring and redesign. 

A.' Operating. Philosophy and Iniaga . * * 

A. I We believe that' RDx should strive for consensus among its members 
and relevant stakeholders concerning its operational philosophy and 
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image* Ve believe that that philosophy should place most enphasi:^ « 
on linkage, resource brokering and probIem**solving assistance^ ra^ 
ther than on research and development products per se. Component 
elements of that operating philosophy might include: (a) client n^Qd 
oT^ejktattoh, (b) responsiveiiess to clients, (c) two-way dialog co^^ 

' cei>i(ing needs, s'olutions^ and reactions to solutions, (d) the broB^e):-^ 
age role (connecting clients to a universe of resoiyrce persons, p^o^^ 

' ducts and services), (e) providing a range of alternatives which 
leave the client with meaningful choice and a* sense of control ov^r 
the decision-making process, (f) follow-up capacity to indicate t^ 

•cliencs that RDx is concerned only with dissemination but wita^ 
the full cycle of problem-solvSBand educational renewal, (g") za^^ 
acity building so that clients oR ultimately take unto themselvej 
the resource linking and problem-solving functions £hat RDx init- ^ 
ially provides. ^ I r 



A. 2 RDx should work to build the strongest possible links to othe f 
linkers, brokers and consulting services in the "totural network" 
to demons tr a tex^irts"H^tH;exclusive and complementary functions, as 
well as to enprmously expand its resource linking capacity • 

A .'i^ RDx shoulJd strive in many ways to cultivate and broadcast, 
an* iji'-age of client-centered resource linking, as suggested'^ 
in recommendation A.l. Image building activities should serve to 
allay fears of other stakeholders, and to develop a client consti 
uency which is aware of and interested in the types of services 
which can be provided • ' ~ ' ' 

i 

B. U^ac^Poerational ;Modes are Most Appropriate for RDx ? 

We recommend that RDx planners and decision-makers review the des^ 
criptions of the eight operational modes we have presented, to determi::^*^^ 
which apply most strongly to the type 5f effort they are trying to dev*^lop 
Jn making this determination they should consider the fact that it is i^ot 
possible to opiate well in all modes simultaneously,' given present anJ 
projected jjesoufce constraints of/RDx. Furthermore, ' an attempt to' inv*^3t: 
in ^too many operational modes/siraultaneously may confuse the image and tlxe 
operating philosophy, both to your clients and to ^ your members • Third J-^^ 
the adoption of somewhat cqnti^adictory modes, for example "Knowledge-B^s^d 
Problem-Solving Consultation," and '*R&D Product Dissemination," may cr^^ate 
role conflicts for persons anH*^ organizations within the RDx effort. 
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Fourthly, menbers of RDx who are Labs ^nd Centers have a history, capacity, 
and i:.age connected with some of these modes, e.g.. R&D product dissemi- .> 
nation, ^but nof with others; hence, if they extend to'o broadly they may 
not be building on existing strengths, and may be acting counter\o the 
expectatio?^ of important clients and stakeholders. 

We would further make a few suggestions concerning the specific rele- 
vance of each of the eight modes as follows: ~ ■ . 

n;^n"\'"%^"^/^^ ^^'""^ Network : Lt is clearly • bev^- the capacity 
l\Tt Of i°llZrlu' T'l completely, in f act. 'lU>/^rKen 'only' • 
^^fL ? federally-funded effort to nurture disselnination capa- 
cities in existing institutions and to fill gaps between them In- " 
sSts' llll'T ^^^^ -"-tegy is tSe'likeSd S re- 

o? oavo-J IT ^""/"il'ility and exhibit little short-tern evidence 
per'iod ^x^Lufn '° ^"^^^^^ fonaativ" 

the ma;v fifflll^l T 'f'""" '^"^ ^'^^ effective linkages among 

the many different natural. networks which exist, however, indeed 
the creation of these should be the^ prime goal ^f RDx in tMs mode. 

roWiXr r-equire^me activfties 

i;teJe':t\°n f constituency and to build an awareness of and 

interest in its general objectiv.es. and its values to that constitu- 
ency. However, it seerfs- unlikely that this will be a pJ?^. "ode f or . 
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. B.3 R&D Product DissemtnaH nn . it should be noted that planned nro- 
active dissemination -is necessary ta-get the wides aid'fuUest'u^li- 
zation of educational R&D.' It should also be noted that R&D CenJe^s 
and Regional L.aboratories have traditionally and some times very ef- 
fectively engaged in marketing ^:heir o.«i priducts. We the^"e rfcom- 
?hL ''f TJ'"" consideratiion'to the place o' and need for 

this mode within a -total system configuration. iJ.particuSr. they 
should consider how new RDx initiatives in other modes Hill r^llte to 

lSea"l" ' n^h s mS^' °'^^°'"f ^"'^ ^^'^'^^ acti^iSes ^hJch'^'a 
i«»early.in this mode. For example; one might ask how "alternatives" 
can be posed fairly and effectively' by an agentUo hai devoted one 
third or more of his or her professional lif^ to the develoomtSt oJ 
only one of those alternatives. " aevexopmeAt of 

e;lsUnre"ffor;' '""T;errh ^'k'"""'^"" """" '"^ is duplication of 
this arL ;£n i" I J" """^ PP°8"8s in the last decade in 

this area than in anf other in information' services, and several non- . 
members of R^x are proven and expert providers (e.« SMERr p?Jf 
. New Haven ERG. etc.). i ^^'S-. &MERC. RISE, 
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.B,5 Rapid Response Reporting ; RDx, needs to experiment with -this 
promising strategy, but to be fully^aware of its cost implications 
and the nece^^ty of being extremely selective and strategic tn the 
questions aiui clients it wishes to cover in this way. After a "ft^ee" 
start-lip period during which the service presumedly proves its value, 
a gradually escaUting f ee-f or-service schedule might be implemented'. 
Rapid reports should\il^o feed 'into continuous flow channels as a 
secondary market,, to multiply the number of users who might benefit ' 
and .to improve the benefit/cost ratio. 



B,6 Coordinated. M ission-Oriented R&D ; This mode is clearly out-' ^ 
side the cost feasibility realm of RDx as currently conceived; how- 
ever, through the feedforward function RDx should play a key role 
in a larger problem-solving loop which involves NIE, universities, 
private organizations, states, and labs and centers. Feedforward 
should serve to articulate re^l and 'pressing client needs and con- 
^ cerns, and should activate the organizations responsible for knowl- 
edge building activities. The fact that Rfix does this-^ith cred- ' 
ible ex^ples) should 'be broadcast to its constituencies so that they 
can understand and appreciate the purpose and value of the feedfor- 
ward function, * ^ 

B,7 Ad Hoc User Re searcH Services : Many people and organizations 
in the "natural netwarks" have the capability of perform'ing such ser- 
vices, and many routinely do so already. Therefore, we would- urge 
RDx not to compete in this area, but rather, to serve as a broker, 
especially to .connect clients to unusuai or remote helpers, ^ 

' B.8 Know ledge-Based Problem-Solving Consultation : Although it i 
clear from much of the early discussion among RDx members tha 
is the preferred mode, RDx should S& cautioned to- consider th 
high costs of providing satisfactory and rewarding services qIl 
y^nature. RDx must be very selective, and perform very well, so 

it i^y serve a^ a model for future educational co'fiTperative extensLffn 
^^nd problem-solving, programs funded by ..federal and state initiative, 
^Ag«i<^^ RDx should operaCe as a br'pker for outside resources who can 
operatt^in this mdde, ^ 

C. 'Monit oring and Continuous Redesign of the RDx Effort 

The KPU linkage-predictive model proposed here represents a reason- 

ably comprehensive and systematic approach to defining and modeling 

the. functions and predictors of an effort such as RDx. We propose that 

som^ such model be adopted or adapted by i^Dx ^^ifnder stand ,\moni tot, and 

_ evaluate itself. We further propose that ^such modeling efforts an^ 

, ' f ^>^-'"*^ 

data collections be used in guiding the cdntinual redesign and self- 
'* . ' ^ . • 

-provement of the effort and. its many ' elements . This'mean^ beginning* 
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with a conceptual appro.ach which is shared by.- RDx and its dclients, then 
basing evaluation and change on that shared understanding, >' 
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Pl'RBOSF. AND SCOPE OF THIS PAPER • . s 

Our' concern here it to arrive at a balanced_don ceptual approach 
to Knowledge Production and Utiliz;ation (KP)j4; one which gives adec^^Uate 
consideration to the needs and operations ^of^oth knowledge producers ♦and 
potential knowledge users. Since efforts such as the. R&D EKch^nge- (RDx) 



are nost often deigned by knowledge produdefs ^afhtr than knowledge con- 
s,uners^we will be particularly cot^cerned with representing interests of 
••clients." The paper is presented Jn two parts. In the first we discuss 
KPU models, concentrating pn\nders tanding \ioij they are affected by who 
creates the^and what assumptions^ are made. In the second^we will discfes 
RDx fxon'the standpoint of the most comprehensive naodels, '^and* make recom-^ 
mendations based on this atialyeis. He will look -at the plhnned activities 
of iU)x using .a set of conceptual aids which we call "operational modes."* 
In^roduced by Havelock (Havelock and^Lingwood, 1973;, -Have lock, 1974)^ and^ 
also used by Nl^E 1^ drafting the specif ifcations for RDx tNIE, 1977).>hese 
mo|^ provide altarna'tive' descriptive outlines for ^analyzing "actual KPU*'* 
. operatiOTiS, within 'the overall context of a general linkage -model. We will 
also go beyoniddescriptions tog look at RD5<^ froip the standpoint of a "li^ag 
predictive" model ?iDrt KPU which is introduced in Part t. , ' 

* - PART I: DESCRIPTION^: AI^D £VALUHTION OF' CONCEPTUAL APPROACHES. TO KPU ' . 
Hqw an individual views the KPU process usualily depends cJn wh^^ 'th^Lt 
individual is in the process,^ V^^'l^^S^ producers, linkess arid users 
tend to emphasize <iifferent- elements, make different assuiiq>tions,f or. use 
different a^arytic^ approaches or different •^models." .Such xonq:eptual 
• individualism aay^makes littrevdifference if- KPU ♦is seen as natutai,_ un- 
' .planned and decentralized. \Vhen a field attempts to alter or impifove KPU 
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: ^ through a plana^ed and^ organized effort. ^however, -different approaches. 

^ ^ 'become a distinct HabiUty. Thgre are dangers that the process' may take'/ ' 
. ■ only.the^r^pective of the mos't dominant group, an/ thus •'S^ff" others, V, 

froa start. .or that the resulting effort may' hi so unrealistic ' that ' 
; • " it bax Ke unworkable (a%. i^ence ignored) by^ sQm.e of the groups ^ho are , 
keys t9.success. The mosc'Ukely prJblem is' that system designers and, 
. .knowledge producers will hav^ more^voice in deciding' the. conceptual ap^< 
. proach to be- used, and' that this may not fit well with the experiences ^ 
and needs .o'f potential "users" 'or. "clients/ cf the' e^ort. : ' 

We cannot claim that the 'development of a.shared. consistent and ac- ■ 

t curate conceptual approach-lS a sufficient condition for "success ini^mpr^^l , 
ins KPU activities, but ye feei that such development is a 'necessary ^oi ' 
^ • -aitio^rfor it.^ KPU^ef forts such as RDx are so complex, and the terminojogy . 
, ^ • ^used to'describe chem i^ so loose, that- disagreements on .gbaU>J-t-^ii^es . 
. . • ^ and outrclc-^syma^no^ come to light early enough. t:o br-Sur«unte* unless. ' 

a common framewoxk exists, ^or't^is rea^d.'as well 48 to provide' a re- '• • 
. view helpful^in choosing the blst modef.' we feel it is us.eful to begin by" ^ 
^ . P^°vidia8fan overview of approaches comcoaly "used.. We wlU -point out the^ 
; - .. assumptions and viewpoints behind them', and develop *n over^l conceptual - ^ , 
. - f ramewok through which p^tsons it^ different points in the ;,roceas, with 
•. ^ different goals and. needs, ban cbmmunicate with each other and orient.' ' 
^- toward the conaon effort. ' ** ' ' * > . 

■ "POLAR" APPROACHES TO Kf U. , / ' , ' 

■« ' /''"^-'^ i '*■"'' ' ■ • 

^ ■ Discussion^^of^KPU mddels freqljenyiy reflect a pplarlty oj^thoug.ht^' ' 

• -between thoseiwhb.-are research or expert-ariented and tho,e.«ho are 

• "practitioner or .Wsumer-oriented. ■ Those at the research pole stress- 
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the "need to be rigorous and scientific in the asse§sment of new progra.-2s 

akd practices, /using comparative and universali§tic yardsticks'. 'Ihey are 

* , , ' "• 

also cpanitted to t^he value a.rj^ use=^f scientiUp and informational t^od- 

\ ' - ■ x- • ■ • ■'■ ' . ' ■ • 

ucts and 'outcomes.'. JhX)se at the practice pole st^e^s the uniqueness of 

ztThe particular user's situation and needs and their 'capacity to^judge for 

themselves -whit, bes-t-fol them and their .si,tuation. In its, most extreme 

form, the practice p/le denies the validity or relevance of any research 

/ ■ ' ' ■ ■ ' ' 

^o"r dfeveloppefet work which is not, explicitly focussed on the specif ic need 

° ■ ^ ."AW". • ■ 

- and the-speqifip copsumer group in question. Thus what works for th^rd 

grader's in Ve'rmo^ mav.be S£en as totally irrelevant and inapplicabl-e .by _ 

third grade teachers in a rural New Hampshire county, dnd,' so on.. At the 

- other extretae there are may be ^ome developer-advocates of educational 

products who see- truth otily in.^nt^> inventions, at\d who strive nightily 



to make 'tfiem "teacher groof i. e. .^incapable ofVeihg used.% practit- 

ion'frs in any way deviant, from their original intentions. The^^^arch - 

practice polarity pennies many of the more .'acrimonious.' debates/ ab'ouit' KPU, 

-an\ each viewpoirit can be conveye^in -either an extremely positive or 

negative light.' The section below articulates' these extremes as ''models" 

whiJh' have a certain consistency and rationality w£thin themselves,^ The 

"ooles"- form a useful starting point or anchor points for much of our 

* -discussion o1c m^rf^inteirateS-approaches to KPU^,^ and as mean^ to evalu- 
^ ^' . ' ' ' . ' 

ate the RDx effort (in PaiTt 2). • ^ • . 

The Research^ DeVeiopinent and Diff usion -Approach , * . ^ ^ 

The "R,D&D" approach J' lews KPU as basically a linear procesg. It 



• starts 'With the ^irpcess of «basi« and/or applied research, then moves 
W into development,' in which the fundamental r^se^arch^ knowledge is-'applied 

I ERIC - . \ • ^5 . / • ^ . 



to the solution of some real-.life prdblem, Iti ©any qases, development 

accivUi^s actually begin., the I'ptanned-for" work.' siijce basic 'research 

"kaowladge is" usually pfcod^ce^ already, £ox reasons /inherent in the sci- 

e'ntifi^c dagire sinply to' know , and without any intent of applying ^ 

fenovl-edse to .any real problem. Once a potentially "usable" product has 

been, developed it mpves into t,he diffusion process: .commuYiication or 

transaission aciivities -designed to inform* aVide audience of the exi«t- 

snce of the '-'produce., " a^nd to provide demonstrations of' it to the "Meld" 

.of potential "users,'' finally, the product is adopted by' some t>ortion 

' ' ^ ■ •' ^ - ■ 

,^of the intended audience or^clientele. Uaveldpk, 1969, p, 10:40, 

for, -a 'List of sotoe of the key early proponetrts of this approach the ., " 
.elements i t^epqjfa fas , ^and how they arViequenceiO . ' 

-Underl^g Assumptions; TheStrflS approach is^ f irs«-bf~all. vAiat 
could call an "acti^fity description model'.". Not6 that it colScentrate* 

%• ' o . ■ ' . Y .y,- 

on^silccess^ve stages of activities, {trying -liteie attd^tiotf to the roles * 

• . V - * * > ' " ..." 

involved,^ who fills them, or micro-level process inv^o^ed in eactit' 

' Second, the linearity a^^uroiition i^ import^t: linearity in terw of' 
sequences oT planned activities, based in rational. declslcJn-making^ and 
on eniplrical knowledge. The notion of linearity\i5 not '.diminish^ by 
a certain amounC of re-cycling whicli may t aket place among . the" stages; / 
from evaluation of usfer impact- back to' re'r-design,.f or A^^anyvle. The key 
point is that product dev^lopment ^precedas any extensive Interact'iqn 
w:frth the specific "us/r," • <• ^. ' '/ ' ■ 

^Third, and related to the above, there is ^ crucial assufip'tion. that, 
potential users are aWable<to the jtational arid empirical.' approa'ch, . oV ' ' 
at least that^they can be "sold'i^r convinced by appeals to the 'inherent-- 
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advantage's of 'using new knowLed^e-based products for. (Change, ' Following 

- v^. \ ^ , ^ 

fron-this is the a^umption that user-s lyr6w how to convert knowledge inte 

^ 9 ' • . / 

b^havioi? — that* th6y know how' to "u^e." > 

fourth, the^equence often begins with existing knowledge or te.ch- 
nolog^,.with the assumption that exist'injg knowledge is'' relevant to the ^ 
solution*" of, some problem,* jor that th* knowl«rige is ^Jj^a%i«, aa#«|^h* that^ 
i^ought to be applied somewhere. Ini many ca^es the model is-'cl«arly^ an 
' advocate f or ^use 6f .existing science, --knd ±^ of-ten used as a selling point 

for the conduct of such researpK, A reiat;ed assumption involves the value 

■ r ^ ' - ^ . >• ' / \ ' " i 

inf ormatipg as opposed to other kinds of products' (services, funding, 

; * - " % ^ ' *V ' ' ' ^ 1 ' 

skilis, political pover^ etc.)* ^ ' * 1 

* ' ^ • ^ " / - ! 

V, * Fifth, trtis approach assumes, that th6 effort is^best planned'and^ 

' , ' * - " ' * I 

directed fri)m the top 'down, ^wh^re- ^*top" is defined as TncLuding the | 

producers and marketers of information or R&D products* < 

Six^h, there is the crucial assumption that the KEU sequence of act- 

; ' \ ^ : ' . 

*ivities can and should be planned fo^, and .often organized into large 

^systems*" This-yl^ie^ tljis approach ^Hite eloseI,y to larger, formalized 

efforts, particularly where pr>)ducar^^M potential users are not parts ' 

of ,the# same* organization. . ^ * " 

' Commej^fc f The R,D^&p mo^el^hars been v^ry successful ia^those situ- 
atipns in .which the assumptip?^ are metT especially if all parts Of the 
p.'rocesS' f rom'researchv'to application are vithin one org^niza^ion'Vor true^^ 
•sy^6^tn,^^with. well-mesbed expectations, roles, procedures arid rewards. % 

This^ may account ior the prevalence of thris approach ia jnili^ary indus- 

« • • . , • 

trjLal^"*6nd (some) governmental ageacy applications. On thfe* other hand, ^ 

... . , * ' ' I. ' . * . 

•the^ very logical and^ sequenced nature of this approaoh tHay he one of i . 



the appeals in these instances. Tfe the ex.t;i8nt .that the leadership of ^ - 

the pffor^t is correct in the assurrJition that there is a work ing sy&^ten 

in .whicrl « assuisotions, perspectives, needs and valuer are shared^ the 

R,DotD approach can fit in jwell. Tj|le question with this approach,; as 

wit^. others, is (to draw a statistical analogy): how "robust" is the 

approach if its underlying assumptions violated?. ' - . ^ 

Guha,and Clark (1974, 1975) perfoirmed a ^rvice for the KPU*conimunity ^ 

by ''pointing out that the, current "unified^ystems" view*, closeJy associ- 

^ted^with the R,DM) approach, is not realistic in education, leading .to ^ 

• - . - ' ' ' . ^ 

a series of failures which tjeduce political support fo;: both R&D and KPU. 

Earj^l^ efforts at "engineering" large sc£ile RfiD/KPU ejffoijts were unreal- 

istjic, they contend, since the various 'groups and prgafnizations' involved 

did not sfhare'coranxon percpption^ t)f 'the > prodiem, yere Independent, had. 

other niss4.ons than either produfcing or'ysing R&D knowledge^, etc. They * 

suggest tlie use^ af the t^rm "configuration" aQ moj;e accurate than, the tpsa^ 

c ' ' ' • - y 

"systecK. " ' Ue think ^t* is best to view the co^nf iguratijAal argumenr 'as 

an# :^{feal. .f or wider-ranging tfioHels and^ appryches, fimes which\fit the 

^'^^'(ftTrito^y" better,^ and which cpcust 'be • eyaltiated. for fit Ijy all potential ^ 

p^ticipants (prodtjcers, iaterped^aries, ^clients, e^c.) before the 

effort begins^ ^ ■ \ , , ^ ^ ' ' \ ^ - • • - 

. Jf ye loo^ at the j^lstory and curre'nt uses oB the R;DM) approach, 

' " . ^ 'V • ' % - ' 

we, see that it iS primarily a 'sy^sjiem-designef's,' manaj;er's, or researchei?vS 

4' , • • ♦ . 

apprbaph*-^ other words, it dees a good.joj^of seeing the world from 

Jhe perspective' of th^ producetVor promoter o5 a* particular field of , 

empirical 'knowledge .J N9t surprisingly, it is^ji^eakest in understSit>ding * 



ds.,^of potert^ij 



the needs'^; of potert^il^l jusers. Nej^d surveys and 'marketing information . 



cannot really overcome this lack» since these miss one o^tclal element: , 
^l^^ccnLiitnient provided to potential coUsuners from leaving* -had ^direct 
input into the planning and development of ^ the effort .(i»e^i "owner^i^") 
The R„D&D approach too of^^n takes a unidimensional^ vi'ew of ^the '"^iser," 



^s ff us^rs did little elso^'than attend to the arriving stream of new 
inf orraation-b^sed products. 

The criticisms above apply especially in instances (such as education) 
in which many of the products come from "soft" social science » rather 
than^"hard" technology or physical science. This, distinction separa^s 
much of "research utilization" from "technology tranter," and the dif- 
ferences are more than se^ntic. In tlje "harder" areaJj of technology: 
(1) innovations exist ipdepei\dently" — they are "things"; (^^^roducts ^ 
and use^ 'may be observed easily, with little measurement error (an ^ 
hypothetical conversation brings this point home — Researcher/devel- 
oper: "I.thihk.you might* be able to use^X to good, advantage"; Pract^ . 
iti"©ner^ "Oh, .but we already do that"); (3) products^ do- not change as 
'they are ^disseminated or relayed (hybrid seed corn is hybrid seed corn, 

b.ut iileas "transmute" as they flow from person to person)* 

' ' h '<^. , ' ' • 

I{> conclusion,^ the c^rucial eleipents of the it^D&D ^proacft involve 

"product" development and dissemination in relative isolatiqyn from the * 



inputs of the particular "user." If th^ product is a technology, this 

separation Aay be less important (and the approach may work better). 

Resistances are likely to be greater in the case of^ informational prod^ 

♦ 

ucts requiring behavioral change^ of people, howev^.r, and it is precicely 
here- that the l4|gk of client involvement hurts most — willingnAs to 

' , , ■ . ' ' ./ • 

change behavior is greater^ when the product se^o, a€ a rest^onsA to 
needs expressed earlier in*^a participative ipannet# 
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TheProblea-Solver Approach ^ ^ * 

This approach makes a good polar opposite for the R,D&D 'perspective. 

itavelcpk, 01969) provides a succinct description of it; ' 

* " • * 

Indhided in this school are those authors who portray the change* 
process as one which is directed towaW solving the problems of a" ° 
specific receiver, and in which the receiver himself is involved 
. thrcughout. Though the recj^lvet m^y be able to create or find suit- 
•^able solutions to his-yoblera by himself, this sbhool i^ primarily 

concerned with those cases in which the assistance *of outside re- 
, sources is uXi^ized;* these " resources are likely to be individuals- 
or groups which ^an generally be reefer red to as "change agents." 
Jhe chatige process may be initiated "either by the receiver or by 
the change agent, but in either case the i;eceiver ^must desire to 
change and must partic^ate ^'ully^in bringing the ^han^e about, 
' The' relationship^^ between sender and receiver is one of collabaor- 
a.tion, and whereas in the S-I ["social interaction" or diffuSilan 
Research' traditionj* and. the R,D&D models ^he receiver wai r-ef erred ' 
to as the "barget system", it is Here called the "client system", 
(pp. 10:54-55) . > ' ' 



lA^roblem-s'olving^then, the fdcus is\learly on a specific client . * 
person or group, and on finding help to meet needs aift solye problems 
for that client.. * ' . • . - ' 

* Underlvi ng^Assumptions : . Thel^ most .crucial assumption, he re is that , \ 
.Chang* activities begin with a felt (or ^ierivable)o need ,of gome, specif ic * ' 
group. This draws heavily on a learning theory appri^acH and^on need ^ 
psychology; that evoking a need is a necejsary condition for change, and 
brings about some so.rt of "drive" to reduce that need% ' 1 * 

. * . ' , . -) - ^ " ' '•: 

Second, the role of the helper or chang^ agent is a^sume^ to be^thdt 
of a facilitator, need-arouser , and Volutibn-f inder; always operating 'in 
participative modes* with, the client.. Indeed, interaction 'Itself ^is'-a ^ ' 
keystone. - ^ ^ ' > \ ' ' " . ' ' > ^ 

Third, the notions of "for<je field ^analysis," and, compaJision processes 
fpr testing, alternative solutions point to an assumption" tljat there "are , 



reasons for the current»s tate of need in terms of baiiriers which oppose 




chang^e* In^ sooe situa^Qns more attention aiay^.be given to neutralizing 

• V- ' \ ^" M. • 

barriers -JZTian to inporting new knowledge or otheip^roducts. 
^ Fourth, the assumed attention of the approach is on process > rather 
thail on knowledge or technology/^ Giving skill y raining , problem-managing 
caoacity, etc, is often more Important than f'ljiding specific solutions. 

' " , I r 

The assunption he^e is that it is* "better to teach a man .to f l6h than to 
give him one fish" — that, given skills, clients can solve more of their' 
. own problems in the future. Thus, the change-agent tries (in the best 
Peace Corps tradition) to "work himself out of a: jo]b."' 

Comment : In comparison with the 'R,D6tD approach, which we may, class- 
' i€y as "fixed" on the knowledge or potentia^l^olution end and "open" 
^"^^ in terms of who adopts or uses the innovation or product, the Problem- 
Solvjer apprQaclj is "fixed" oa 'the client end and wide open in terms of 
which solution will be chosei\. Among some proponents,. eVen the process 

■ \ 

by which' the change agenc works is kept deliblerafcely t>pen, so as to best 
♦ \ ^ ^ , • 
fit t;he particular grpup and^^|b( needs. * . / ' 

* this is the*nQCion that information is only one kind of sol^ 

ufio^i, and often a less-useful one. Information (particularly that based 

'/*on -R^D) Is harder to use, since mote steps are requJLred than solutions 

wKich give capacity, power, or techniques* R&D information is also only 

% -J . one' kind of Information, and is usually less preferred than non-empirical 

forms, many of which are available ins ide as opposed to ^Outside of ^he' 

^ client organization (see van de Vail, 1975). V ' - • * * 

^ ^ In Me sense the Problem-Solver approach ia not a complete model f9r 

' KPU^^ since it -is not particularly concerned with problems of knowledge 



or innovation production and dissemination. The approach is yitally 
concerned with getting results and with helping, howe^ver.; 'ind it^oes an 
adru.rfeble job or capturing the KPU proWLem as client groups . look at it . 
Clier.rs oftep retrench more firmly into this position when* they encounter 
KPU "syscan^** which cannot meet their needs. ^ . - ^ 

OVERVISV OF THE "POLAR" APPROACHES 

The general conclusion we reach in reviewing these^ approaches is 
that neither of ct^^ does a complete job of describing or predicting KPU 
phen'oc!,ena, and that ^ach has its particular biases ;or. set of blinders 
resulting from who f'fermul^ted the approach ^d for, what purpose. ^,D&D ^ 
is a^^roducer's approach,- while Problem-Solvi^fe caters to actual or 
potential appliers. In part thes^ differences result from the selectivity 
of attenti&n one must practice in order to understand even part of a com-- 
plex pheVpnehon. - , * I 

We\r6 not downj^laying the power or ujiility of either poilar approach," 
however, J^en they are applied to. situations similar to those for which 
they were originally created. The difficulty corned in trying to adapt them 

to other areas where they may not fit. The *real, danger is, ^however, that . 

• * "> • * 

we may not know if |6phe model fits: models* tend to shape the siiturftion to 

L ' ■ .•'''•■■<'-. 

which they are applied,' or at least our perception of that situation, 

and give no outward signs that they are missing important elements^, inter- 

^*actioWs, and outcomes until) it is t;9o,late — unt^l the effort misses in 
reach iSgf its objecl;ives, and until^the comjiiaints begin ta be heard. ' The 

'importance of an accurate model or approach is more than an academic ex-- 
ercise: /models lead to activities, and decisions which- focus attention, 
effort, and dollars. synthesis thus seems to be required; one whic.h is' 



coiaprehensive^ provides a mechanisp for reality testing,, and yet is not 
compiax-th|.t it cannot be dealt with and understood. The linkage ap- 
proach discussed below is, we f^l, a good synthesis;^ especially as we 
will expand it later. , . 

LINKAGE — A SYNTHESIS . ' ' ' \: 

Havelock'(1969) presented and Havelock ^nd Lingwood' (1973) elabor- 
ated a '^linkage model" of dissemination and utilization in an attempt to 
bring^^ together the polar concerns of the R,D&D and Problem-Solver ap- 

\ 

proachts. Linkage as a concept has been widely used since then', but it 
has never been precTisely defined, leading to the danger that every role 
ahd KPU act might be called "linkage," to tJjjB detriment of clear under- . 



s tending 'eof what_is meant* _ 

Most simply, "linkage" is a "XfoVig relationship between any two " • 
partiei^.pfersons,' or elements*" In the context of knowledge production 
and use, a more satisfactory definition might be "a relajtionship betx^een 
a resource'person. (or group) and. a ^practitioner (or practice organization) 
which continuously facilitates and promotes mutual information exchange 
arid ;h el Ding aictivities with respect to ^gnificant practice needs X^Each 
of the underlined terms' deserves some sj^ecial note: "continuously" because 
linkage cannot, be a one-time or fleeting phenomenon, but something which 
allows a continuing flow; 'If acilitates" ^nd "promotes" indicating that it 
fleets -openness both in a passive and an ictive sense (e.g., listening - 
^and talking, no^ just waiting around'for exchange to happen, but actively 
reaching ouT /to make it. happeiK>utMal" in that both parties oust talk 
to'thfe other and listen to the other and^ be willing and able to reciprocate 
talkii^ (or writing or presenting) • and li:si^efiin^s<or reading or/viewing) . 




Furtheraore, effective and meaningful linkage 'probably must go somewhat 

« beyond the =ere passing of information to some level of 'mu'tual commitment" 

and. involvement which could be called "helpingJ'Uhis mightXbe in the farm 

of tha provision of specific technical assistance or merely t^k'offerini 

of opinion, guidance or encouragement. -Lastly, meaningful tfesource-user 

linkage ought to be focbssed on real practitioner' or consumer "n-ieds,'" not 

/prLT.arily 'on what the resource ^)erson or gr^oup wants to provide , Defi-ned * 

I • . - ■ • - '■ 

in this more elaborate way, it is clear that "linkage" denotes more of an 

• Ideal for resource-practice relationships than a typical description of ' 
present-day reality.- thus, it is ^ muc^^ a prescriptive ag a descriptive 
term, " * „ » 

There.'is^a cyclical nature to linkage. Havelock '(4969)". notes : 

JThe c5iib"i^t~"ofViInkige~starts with a focus Tn bhe^ser 'as'a'- ■ 
problemr-solver . -We musl first consider the Aiternal problek- 
solying. cycle yithin the user ... there Is an initial "felt need" 
whic*-^ds intoU-Z'diagnosis'.l.any "problem statement" and works" • 
througK.^earch" Snd "retrlev^fhag,es to a "solution's ^nd tKfe . ' 
\^nni,. = 5fion' 6f that solutiqS:. B.itF'f.., the linkage model 1 - . 
that the 4iser must- .be mean;lngf u'lly T.elated to outside 
■ r esources . . . . Th\e user, must make contact with the ouCsi^^^- 
source system andNinteract , with, it, so that he will get back Some- 
thing relevant ...The user "must enter into a reciprocal relation - 
shi£ with the resource system (which].... goes beyond the point- 
of improving individual problem-solving processes toward the /f 

"^l^'^^^^^ l°ng lasting, social influence, networtcl >• 
(pp.- n:l?7-18) V . i . 

•I . • ■ / 

s, ^he linkage between a potential innovation/knowledgfe consumer^ ajd- 

• ' *. ... : . ' » , 

tside resourced (groups or individuals) fs inif;ia1fe by the needs of - 
tfiit consumer, it lasts, over time bayond the particular problem-of-thi- 
moment, and it allows the consumer to .influence, the erovider in" turn./ . 

While linkage describes 'the process, it does not signify^ .what gies 
oh 'within' of through the linka'ge^ Havelock and Liagwoo^l ,^973) suggest 
that ghe. dynamic^ within, a linkage may be suSimiirized as transmission 
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and' transformation activities: , x * ' * 

. "Starting, with the user's need , the -first task id to transform the 
need i^^o an expression or articulated messa?^e..of need > Subseqfuently 
tjiis message must be- transmitted to resdurcers Then the need must 
be received, and^ transformed by the resourcers into researchable qu^s- 
-i, ' tigios^ solvable'^ problems ox di^gnagtic statements > The solution out- 
p^nw then must b;^ transmitted back to the user •..^ and finally, they muft 
' ^/ transformed again by' the user inta Actual solutions ^r need reduct - 
ions through his testing, consumption, or integration efforts.. (p. 81) • 

Linkages', then, are complex exchange interactions. Havelock and.' 

Lingwood (1973X identified functions performed In six components of link- , 

'ages« at the system level. The six are: use^ Self-servicing, need procea- ' 

sing, solution building, solution processing, micro-system (interaction) 

building, and 'macro-system (overview/monitoring/contr.ol)- building. We 

will not specify each of the functions here,* othej: thaivto note ^ that ^ach 

y ' ^ " ' . ' ' < ' ^ ^ 

of the functions involve transmission, translation, definition, and be- 

^- ' - ' 

havior conponehts. "^fhe analytical framework is shown In Figure 1 ^ 

. * ' ' «i * 

. • , (Insiert Figure 1 about here} ^ - " - ^ ' ^ 

Linkages may bej^ace-to-f ace or, particularly In large^ dispersed . 

• * ^ ' • ^ 
efforts^ indirect. In the latter the partners operate through **mental 

images" of their linkage partner. To the extent that the mental images* 

diverge from the realities, linkages will be less effective. I^^ther 

wdrds, linkages may be seen in terms of person- or or^anization-percep- 

a * >• . ■* t ' "« 

tidn*, and th^e accdraiy of these perceptions, affects all confponents in 



accural 



£hfe Figure. * ^ 

Evaluating >the Linkage Approach - / > 

•r V- • • ' . - ■ . ' ' 

- The linkage model bencf i'tted.f rom an integration of the peirspectives 

and research which were available within the .earlier KPU models. It has ' 

i ' ^ - ' ' ^ , / ' - 

been used irv.both research' on- R&D systems .(Lingwood Ind Morris, 1^76), ' 
and user and changd agent training (e.g., Havelock, 1973'; ^llavelock and 



Haveljock, , 1973), and it has proved useful in bpth situations. Still, ' 

' ' f ,' 

the utility, of the model appears to come frc^ its very breadth, and per- 

hap5 to soce ext^t from earlier lack of explicitness op the concepts., 

/^""'^ ' -\ ''^ ^ * 
•which allowed each student X)f the approach \o xead 'into it what he or 

\ " 

she wanted. The very comprTehenstveness] of the approach may^also hinder 
its .iilu ity in g^ecific inst^tlcfes., ^fhe approach also was proposed by^ 
researchers who were also interested .in action and change, byt s^ill 

list be noted that the authors- are .researchers. Finally, this ap^pro^cfT 
is more descriptive th& predictivisL Thougfl there have been' several 
attempts to identify factors which prpmpt^ linkage (e. g. , ^Hay^locK, 196? 
pp.*ll:20-32; Havelock and Llngwood^ 14^73, pp^ ^94--?06)^ "these factor 
a^e not* a part of the mo.del it&elf .' The app^Coach concentrates oa the 
linkage7i:ALated f unction^.of^roles and^organiiatjtDTis, "j^thout integratin 
these into Qther* non-linkage activi^es. . v , 

As with other models, linkage also suffers frpm/the tendency- to . 
choose criteria of convenience; ^electing thos^ things we cap measure ° 
mos-t easily iri determining ^effects and outcomes. ^^Jt Is easier, fof^exr 
ample, to measure dissemination or transmission 'activities than to * 
de^^mine actual use or^imj^act of either innovat'i<)ns. or nee^ds* * ^ 

We feel there is* still gl^e^t potential in the lipkage approach, 
particularly for RDx» Elaboratton ,is n6eded, .however, [ particularly In 
the areas pf: development of a causal/predictive qontext^or urid^r- 

' . ' ' , ' '^i ^ ' 

stqndin^^^nd developing linkages, and (2) Sjpeclflcati<>n of- exactly what 
W6 me^n by rfl^kage^and^ts predictors' (i.e»/ to insur e that the predictor 
concepts are not subsumed within the lipkage defetnlti^htit^elf) . We wdll 
begin this process witt the .•'linkage predictive mod,^2(V introduce<l below. 
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A "LINKAGE- PREDICTITC'^ M OnFT. 
* ^ ■ 

Our basic classif icatipn of predictors comes from: (a) the no.tion 
(supported by the Gork of Cuba and ciark) that a predictive scheme must 
be ser.sitive to cross-system differences or incolpatibi^ttties in basic 
goals, independent or uncoordinated activities, lack of central authority 
etc; (b) that linkage i^ affected by the characteristics of each, system 
and the linkage '^'partners" who cone from these systems, in addition to 
the effects of ' the linkage situ^n or medium itsdtf; (c) that'linkage 
takes place between the oari-nprs, not inside the systems. There are " 
several sources of inforiaation which we will combine in setting out the 
vnature of these^^ious predictive forces. First, we have available 
theory and model discussions (e.g., work of Havelock, Cuba and Clark,' 
and- others). Second, we have reviewed sources such as NIMH (197i), 
coding predictive forces. ^ 

We think it most instructive to classify types of linkage predictors 
accord^^g to the following rough levels; (1) societal; (2) systemic, 
organizational «d inter-organizational; (3) individual and interpersonal; 
(4) procedural; and (5) content (type fl£^noyaiian^x„inf^.rma^ion...tranfl-~ 
mitted). Let's take each of these 'in turn, to identify the important pre- 
dictors we have found which relate to the probability thaf-linkages will 

y 

form, the process oiE linkage, or the ultimate effects of linkage. 

The Societal Level; Here we are concerned With direct effects of' 
^cietal forces-such as regulation, law. support, etc., rather than the 
^"^-'^^-'^ effects societal factors may have as organizations and indi- 
viduals attempt to operate based on their perceptions of societal fac- 
tors. At one level we hear that the general "social climate" either 
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• favors or inhibits change, and this can be seen on the large scale if we 

compare vhola socijec^ies (cf. concepts of traditional culture). "The tesr.per 
. ^ ( 

or Che tines" as aN^actor also alerts us t|)' the fact that innovationteay 
be ea5>- or difficult irj. different periods of history: the broad sweep of 
which has, in wes^rn society, been toward lower dognatism and easier 
change, U'ithin short time periods we see differences based on more tran- 
sient econotnic factors and the somewhat cyclical or even faddish shifts 
in the focus 9f societal concern (e.g., civil ^rjghts,' environment, womens' 
rig'hts, energy, etc.). In the present case of education, we seej^itect 

governmental and 'social intervention in bpth the leyel o.f support for this 

\ • 

most visible cultural "cutting point" and the p.ush for thqse areas in 

« 

which the cutting should take^place. Ironically, societal concerns may 
well have changed about the time the e^ducational system begins to turn 
out individuals skilled in the areas o.f social concern" v^hich were pushed 
for earlier. 

The sector of society vrtiich provides R&D solutions is also subject to 
societal/governmental/political factors, especially now in the days of 
"big science," when mission and program orientations coming from the* 
■go>rerfmSrt'"Tt^^ type ~oF R&D which will be conducted (and^demaod ^ 

greater relevance as^ a result). It is not the case that R&D truly lookjs 
ahead to many alternative failures, having knowledge on th^ shelf no" mat-, 
te^ what tlxe direction of societal concern. R&D is subject to time 
c^Ies also, and the coaceros may have shifted before the results cojae 



In; and the R&D tim^ cycle is often longer than that in ^educational prac- 
tice.' 
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There are two kinds of predictors^ we *need to identify at this and any 
<• 

other level: those which affect both users and solution-providers equally, 

\ 

and those which affect one potential linkage partner exclusively or pri- 
marily* At the societal level 'We might find that a "tight"^ economic 
picture liiaits both the ability of R&D and action agencies to produce 
solutions and the ability of educational practice to innovate. Alterna- 
tively, funding might simply shift from R&D to delivery, thus affecting 
only the solution-providing side. 

In summary, the societal level provides a definition of, or sets pri- 
orities for, .concerns at 'the basis of KPU processes. Government provides 
resources and serves either to mandate or facilitate linkages (or non- 
linkages). Political and social processes at the local level affect the 
educational user side primarily — a particularly pressing issue at the 
present tirae,^ when many local forces are pushing for a return to' the 
"basics," wffen millage elections fail repeatedly, and while at the same 
time^ solution providers are pushing, many potential innovations. 

The Svstenic'or Organizational/Inter-organizational Level . The 
* organizational characterist?ics and'^^)rocesses which affect linkage and 
Change look very 'much like principles important in modern organizational 
theory. This is no surprise, since organizations do not exist in a 
steady state, and to be effective must be able to change^apidly and 
efficiently when conditions warrant. Few ties have. been made between^ 
organizational and KPU theorjf, however. Perhaps few org.anizational 
theorists hav^ looked at KPU .since knowledge (particularly empirical 
knowledge)) is pnly one s timulus among many from the organizational 
change perspective, ^nd is often less powerful than leadership mandates, 
economics, etc. , , , 
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The following issues, agai^ factors whi.ch look very much like elerr.ents 

in theories of effective organization, are important in predicting linkage: 

goal clarity and decision-making processes to achieve it; sys- 
tematic, planned processes pf action 

9ozru.t:t8d leadership, leadersliip openness, skill and support 

participative proc^esses for problem formulation, need-sensin;? 
and. .de cis ion-mafeing 

financial capalcity, size and 'stability 

,,_^f^^^^^^^^t±onal climate supportive of change, cohesiveness add an 
error-embracing" (Michael, 1973)^ approach to planning J/ 

an organizational structure cbmpat^^ble with change^ 
^ positive collective' attittJdes and motivations of system members 
security, reward based on change-responsive perfo'rraance 
perceived benefit of change. I 
Lingwood and Morris (1976) found that these factors", were very 
important i.n the ability of an RtD organization to help its members make 
contributions to applications of knowl^ in addition to the cumulation " 
of knowledge itself.' Thus, these factors affect the ability of producers 
to produce useful information as\well'as the a'bility of clients to make' 
use of it. ' 

Inter-organizational' Linkages will form attd endure only to the 

extent- that they are seen as beneficial to each o^anization. In the 

case orf R&D, if the researcher is rewarded only for jqurpal publishing, 

*and the goals, of 'the organization are seen as tied, iko producing new kpow- 

- V 

ledge rather than helping others use it. then few ap^^i^cation linkages 
are likely to form. On the other side, if the atterili^^i. df potential ' 
client organizations is set on simple survival,\nd if littie,>leadership 
support and payoff is put oh looKing outslde^f or*^6aut'ion^ • and expertise,' 
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than again linkages are\^t likely co form. Perceived benefit nay 'be the 
rost efricisnt shorthand ter.-s for this pr'cdictive force. 

Factrrs internal to organizations control inter-organizational re- 
,i£::icr.3 leading co linkage, as well: openness to outside help, ability 
cc lead E-d zeach lay/comaunity power figures while being flexible in 
regard to ca-ands cade on the organization; and a sVill base among those 
' vho will be ir.volved in linkage, or the ability to give those skills. 
Many of Che -est successful inter jcrgaaizatio^al linkages co^e during 
problep.-solving approaches U whi^^h. the traditi^al tactic of searching 
for a higherrlevel or super-ordinate goal is used\ 

The Individual Level: In one sense, individual\predictors 
^nirror organizational ones: receipt of what is provide^^(e.g. , training, 
perceived influence, help, peer ^support) , response to initiative^ of the 
orgaiiizacion, reaction to clrir.ate factors, viewJ of change, etc. Behind 
this are personal .knowledge , -attitudes , and behavioral skills relating" * 
• to linkage and change. Important among the attitude^s are innovativeness , 
risk-caking, tolerance of failure, openness to experimentation ind empiri- 
cisp., lev; anxiety, reality priantation, etc. Skills include interpersonal 
relations, problem-solving, etc. Some personal characteristics relate 
to the above: education and training level, experience (though the liter- ' 
atare is nixed on this), and so on. 

Individu:;l characteristic^ also affect and are affected by the linkage 
itself, as it forms and natures. One of the key ingredients here is the 
t.y?5 6i problan-solving process or general interaction style used by the 
Unkage' partners over tine. It is difficult to specify the^ factors ■ 
, brief l/, since. would be entering the fields of dyadic interaction, 
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.interpersbnaT attraction, and exchange theory. Furthermore, many of thti 

training approaches used in change Npigentry stress the interaction skills 

• . \/ ' • ' ^ ^' , 

and c^echniques, both from che perspective of what the' partners should 

brjCg tQi the interaction, and what should eraeVge within it. Over tiT.e, 

the liTkkage perspective would stress reciprocity as the key elBtr.enf, 

tieing in closely with the notion of linkage as exchange . At some point 

it becor.es difficult to distingaish from the individual and the procedural 

■ factors below. . 
\ . ' 

Tha Procedural, Level ; Here we are concerned with predictors which 

come f ton, t^^e nature of the communication or Tiokage media used, and ^rom 

the'^ongqifsl Jink^tge experience^itself . In' one sense "media*' is iixdis- 

tinguishable from the concept of "proce^ss" (as change agetits use the term) . 

Ope 'v^y ei^ecTi^nt is redundancy in the linkage media or processes - then- 

* \ / ' • ; • 

selves. 'Multiple, synergistic approaches have the^ advaittage, as str*ategies 

^far overcoming information losses in each channel. the'faraous 

**J^iiure to communicate." RepeVltion is one form of redundancy, and the 

interpersonal media allow repetition with clarifying modifications, based 

on feedback ,(^.g. the qufestioning look or shake* of the head), from the ? 

linkage.^artner. ^ 

The diffi^sion research tradition points to the need to fit media with 

^messages. Interpersonal n^dia seem best for making "entry level" contacts, 

establishing rapport and accurate perce^ions of the partner; chey fit in ; 

well to establishing needs -and goals. The impersonal media seem most 

efficient latej:, in providing specific data once momentum arid processe's 

have been built. 



\ ' The Contenn Level : Important her^e are factors anhereat in ^e " 

particular innervation or inf orraatibn ,ieing transmitted in t*he linkage* 

Much, of the concern rests with the concept of "innovation-organization 

fit^." Adv£r.cas.e goes to those innovations or Messages whith: are lower- 

cost evert ^^ocessas; are of high quality if an R6D product;^ merge well 

with existing progedures, organizational structures, theories and styles; 

have ar* enduring influence, yet may be discarded easily; and are self- 

suppgjting in providing assistance in adoption. The difficulty comes, in 

■^ke^ing this list of characteristics of "linkable' content" from defining 

messages or priDducts which are trivial in natures the $eai;<!h- for "pain- — 

less" innovatior^s often proMuces ones which are, not worth the effort. 

Putting the Model Together. , ^ ' , 

• « ». ' 

figure 2 shbws' one way to integrate "the predictive factors we 
have bee?^discussing. Influences flow downward from the societal to the^ 
individual l^vel, as we A as to the linked systems and elem^ts (persons, • 
' groups) involved i« th^e linjcage. \ Though the model shows a formed linkage, 
we ne^d^to remen^ber the the predictors also relate to the probability that 
a linkage will form in* the 'first pla^. ^ * ' - * 

^ ' . ' • [Insert Ffeure 2 about here) . ' ^ ^ 

*There 'ate mutual effects between organizatian§ arid individuals, allowing 
the linkage Cjpartne'r to'have an effect, and to be a'ffected by,^ the support- 
ing organization. Procedural and content factors ar^ also interpreted by 
linkage partners in the context of the organization from which they come;, 
While t^is dia'gram identifies broad types of predictor^, it does not 
show the dynanics of "how th6y operate. The dynamics are crucial: 'any . ' 
approach which sir.ply lists classes of predictors or gives, a ^'checklist" 
also misses this point. Such an approach' also would f-aiL^'since it woyld 
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contain no way to consider more than one or two factors at opce — it does 

little good to represent a complex, multivariate predictive relationshi? 

or .Ifirse *'systei?." using methods which blind us to that very conplexity. • 

In Apoendi:': A we present a statistical mo^fel which may be u^ed as a 

.rough starring point for further refinement of this approach. 

We p.ropose that the predictors may affect linkage in one of four 

different ways: , - 

(a) as external- forces which affect both linkage partners 

and their organizations^ equally , but which irtay vary from 
linkage' to linkag^ ' . 

'(b) as forces which affect one or both linkagje partners, but are 
unrelated to each trSher"""' - " 

fc), as forces on which. t}ie similarity of the partners is crucial 
("homophily*'), and 

(d) as forces^ on which the partners must be coripatible , but 
not necessarily similar. ^ . 

* • ' 

Points and ate the most important and complicated, and quite a bit 
of atten-tion is given to defining these in Appendix A , 
Comments on the Predictive Model 

ThiSy^model also has its assumptions, biases and' weaknesses. -Perhaps 
the most important assumption^ are that th6 mutual perceptions and inter- 
relationships of linkage partners are crucial in KPU; and that. KPU is an 
exchange relationship ^ "Exchange^* assumes that both partners are 
affected by (i.e., change as a result of) their experiences. Thus, the 
concepts of individual and groujJ openness to change are important for bot 
linkr.g'h partners. Al^o, this appi^oach assumes that it is possible to 
capture the dyhamics of KPU s-ituations operationally using methods more 
powerful than simple case-studv descriptions. Related to this i6 the 
assumption that statisti^cal methods are now powerful enough, and that we 
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cap. specify observable quantities accurately enough > to make this cpa\plex 
rcdel vcrk.^ Further, the approach assur.es Hnear mult-ivariate. causality 
and :he flow of predictor forces, ra'ther than wholistic or gestalt intar- 
accic~.s cf forces.' 

i."e apprcacn r.ay prove difficult in situations in which linkage 
activiries ^r*a handled by many different groups. This is basically a 
n:e:hodological ^roblen in observing and collecting needed data, however. 
Moreover, the model requires us to JLpok behind the scene, behind the more 
easily abserv.ejl descriptions, of linkage activities;..±t also requires jus to 
extend our analysis over tiqfe. We need to remember, however, that the 
analytical difficulties are not caused by the mociel itself, but by tha 
complex realities the model tries to capture* 

In Par: 2 we will use this m6del to evaluate the different "oper-^ 
, ational '^odes" which have" been used to'describe RDx plans and activiti-Ss. 
The nodel vill beco^ne a testing point for the extent to which each oper- 
ational node is helpful and fits with -the background realities of KPU in 
general and educational KPU in particular. * 
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PART 12; EVALUATING RDx FROM THL LINX^GE VIEW 



\ 

' Our ciscussLoa of the polar K?U models ^nd the linkage synthesis in 



previous^ sec 
iictive factors, 



:ioa provided the definition of terir.s, overviews' oi pii- 
and the geaeral conceptual approach we bring to the- task' 



ev^r, -we need a 



of evaluating th^ RDx effort. Before we can begin this evaluation, how- 



'*interfaca" between ^he KPU models and the , plans for RDx. 



KPU models are necessarily abstract, made -so by the scope and complexity 
of the phenonencj they cover. We will translate the raotiels into more oper- 
a^t'ional terins tjirough lisc of eigbt "opgr,atto^i^l modest for KPU, modes 
which were themselves derived from KPU models. Since, the jnode^are pri- - ^ 
marily Rescript jive, ho\>?ever, they cannot pr^vide'the needed" perspective , • 
of pre'ldictors, op linkage; therefore, we will also explore the important 
background facnors operating on that mode in the context of RDx. 

, When we have finished with. the individual operational modes, we*will 
go on to summalrize from three perspectives; (1) frob the characteristics of 
all of the operational modes; (2) frpm the many linkages planned for RDx^, ' 
and (3) from the predictive perspective. ^ After t^ese discussions we will 
include a section covering the overlaps and disagreements we see between 
6\iv approach and those of the other RDx Authors* Finally, -we will draw 
all of dhi's together into a series of recommendations for 'the RDx effort. 
THE QPEP^TIONAL^ODES ' 

A great deal of the trontusion which enters discussions'.^* of Mnkage a?id ' 

' \ 

KPL* functions' generally arises from the fact that different .discussants 
have very- different systems and functions in mind at the opefationaf*' level , 
For exariple, a very specialized information service for a veijy specific 
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ar.d linitedfgroup cf clients, e. s- instructional materials an4 aids for 
tsacl-.f^r? cf deaf children, will be vastly different in operational terrrs 
.Tc- a ser.eral inf or^.ation .and referral service, ev^n though the sane ' 

^ lin::2;d'prir.ciples and terminology .apply to both.. In an attenp^t to clear 
ava;- soze cf this confusion we h^ve proposed ^Havelock, 1973; Havelock ' 
anc Lin^ood,M973) eight alternative operational modes to* describe KPU 
syste-s. Although each mode fits' the linkage paradigm, the specific 
referents are different, sometimes cadic^lly different* Consequently, 
any attempt to make cbmparisoQS becomes an .absurd axercise. The arena 
in which RDx will operate makes a good example of this; RIh« is in part 
an effort to br ing • together the dissemination activities of seve^-al dif- 

-r^rent organizations, each of whlth has, been working in i-j:s own operational 
node or style for several yea^;;s, ^servin^ different clicnte- with different 
conceptions of service, offer^g different lines of product/ and/or ser- 
vices, within different time framesT^tc. 

To ancnor this discussion', we can first identify the two modes which 

^represent tha cwctreraes of specificity and ^lobality for KPU systems: on 
the specific end, we have^ the "Coordina'ted Miss ibn-orien ted R&D Program" • 
(or Project))" a h-igh-i-y" tnt^grat^d UtikiTtg^f spex:i«:c-xcsearch^s^vst= 



opers and clients dver tim|. On -^e other dxftreme is tlie "natural system ' 
or network," dealing with- those organisations and' interactions which have 
existed and now exist. RDx 'plans activities at each of thesd extremes, as 
we ^rill see below. 

On one hand, regional laboratories and centers have,^in the past, en- 
gaged in progrannatic R&D, cone of it. following the complete closed loop 
^approach represented in t|^e "Coordinated Mission-Oriented" mode (Mode No. 1); 
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^Wisconsin's Individually Guided Education (IGE) program might be ci't^d as / 

on? of the most, positive ^examples. On the 'other hand, with the fomati^a 
* of these sazie labs and centcrs'^are now setting theiaselves up ^s ^a^ - 

goneralizad resource system,- dra^ingl ujlon the entir^ knowledge base or odti- 
cational Rc.D. The "natiiral networks" are important adjuncts in any ^f »the 

efforts. ► ^ ' 

The specif ic/global dimension is not the only one- on which the 
operational modes, and the KPU, efforts they describe, may be ranked. Per- . 
haps more important is the dimension of client orientation , the extent of 
/input or control clients haVe over the^ processes- an4 products of the effort. 
This Ife the dimension we" will use below, arraying the operational nbd^ 
from the least to the most client oriented. In other words, we will» 
work f ron those with the^ most renope need-sensing (disjoint in time^nd ^ * 
norsativ^), to the most'^inter active ("synchronous" with solution delivery 
and individualized). On ^his dime^ision the' "natural network" offers the 
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Je^^lient-orjLented capabilities^ .and "problem-solving Gonsirlt^tion" thfe 
"mdslj^Ln many ways thele p$Pallpl Stages of KPU -development; but fiaay. iodes 
arc alterifetive ways of accomplishing given objectives, not sequential 
steps all of which need be takenT kftj^ presenting all of the mbdes we will. 

T^i^rSrrtKTlI^^ ~ 1^ 

As' W jdiscups each mode and the plans RDx has for. it, we will also briha 
in the' linkkge-predictive model, specifying those background forces which 

^ appca^T crucial to the*^ s^^ccessful operation of this mode^ or which may fom 

I. ' ^ ' - 

substantial blockages to its functioning. , * 

The "Natural Network" Mode , ^ 

♦ - - V 

Description ; This node uses interconnections and information flj^s 

/ • , ! . , > 

which exist^ a'niong the various knowledge producers and among the^ various 



practitioner and consumer groups. This "system" includes all the know- 
ledge productd by Vesearchers and developers over all the years t^hat R&D 
^as been performed. It includes government and private sector actors, 
private enterprise; R&D labs and centers, universities, professional 
associacicns, libraries, resource centers, and sundry information sei^ices 
One vi^ of appropriate government action and ^intervention in the infor- 
nation field is that of noOr ishina this natural network, building capaci-- 
ties, filling gap^, strengthening the weaker elements, and facilitating 
interaction among the various elements. Thesfi elements should not'^be 
thought of as ,a "system," if we are tb follow the cautions of Cuba and 
Clark, since the very diversity and multiplicity of these elements almost 
guafantaas that they will differ widely on goals, procedures, approaches, 
needs, rewards, skills, etc. • ' ' 

It is important to note how vastly different this "natuVal network" 
is from any of the mor^ coordinated modes we will discuss below. The 
users and' the knowledge producers in this mode are many anjTvaTTpd; and 
the channels used will also be diverse. 

RDx Pla^fys^ Natural networks *are important background factors, and 
RDx will, according to NIE (1977), "...concentrate on strengthening 
these channels and making sure that; high-quality R&D outcomes and 
•exemplary practices ate available." Given what we have said above, we- 
doubt that this "strengtheTiing" can be brought about b^ providing infor- 
p.ation alone, or eve^ primarily. Strengthening will have to take the^ " 
form of reducing oi^ neutraliz.inp, forces which now limit each two-way 
linka'ge . Of course, the assumption in the quote th-at^R&D outcomes 
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and practices are the materials needed also requires testing. Many of 
the two-vay linkages probably are carried on with very small corr.ponents 
of R&D/practice information. Policy and practice groups, for e>yaQiple, 
probably'spend much more time on* political and requlatory matters. And 
again, the nature of the natural network approach requires that analysis 
not be limited only to the more visible linkage between R&D and practice. 

Predicti ve Factors ; In one sense, it is hard to apply the pre- 
dictive model here, since tW level of "linkage" is so low across most 

the natural network boundaries that there is not much linkage behav- 
ior to analyze. Natural networks siich as exist have certain advant-. 
ages. in terms of the societal ^nd qrganizational factors relating to 
start-up and funding — they are simply already there. Key elements in 
prediction are, however, the magnitude of differences aniong the ra^y 
relevant organizations and groups, each of which will have much strong^ 
internal linkages: than external ones. • ^ ' ^ 

.The "natural network" taode certainly has cost and" timing'advantages: 

' < • . ^ r ^ 

it is easier t9 chink the holes in the wall than to build a new structure, 
further, the oi^ga-nizations and channels already exist, so they are rela- 



tively familiar to their users, and 3tart-up^and training time is mini- 
mal. On the other hand, one has to answer one' simple ^l^t often painful 
question: if the natural netwbrks are so attractive, \why aren't they 
^94^3 the jDb in the first place — why do we need to gef involved? 
fher6 are probably very good reasons (organizational, political, f^inan- 
"cial, interpersonal, value-related', etc.) why there are "holes" in 
the natural network.. Further, by assuming that there a network 
we may blind ourse^^s^o its level of efficiency — which is likely 
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to low where "linked** organizations op sectors differ extensively 
op. go&ls, procedures, etc.^ I^inally, those who are linked across the 
rost divergent: sectors are likely to be atypical (such as the grade- 
school teacher who attends the researchers' convention), and the net- 
work -ay r.ave little ability to expand further. 

It is ioportarit to use the natural i^twork as, a starting point for 
analysis, ^if nothing etflse. The type of analysis must be more -than a 
sirple description o^ the linkages which- now exist; it must probe into 
the reasons^ and rationales — .in short, it raust use the predictive 
approach to understand why things are> as they are. This means that 
■.each of^ the possible two-way linkages between organizations or sec-- 
tors nust be analyzed sepajrately (e.g., R&D-practice'; R&D-policy; 
policy-practice). These Analyses will probably have to stop ^hort of 
includir^g the interpersonal and individual predictors, since this 
would require an excessive level of probing and data collect4.on, much 
of which night be objectionable to those involved.^ li is certainly 
not possible to do this analysis here. We would suggest, however, one 
possible process for^it: representfa^ives from each group-could be 
brought together in separate sessions, each geared to -analyzing "one 
of the two-way linkages. The agenda would bp -to describe the current 
linkage, and to suggest reasons (classed by societal, organizational, 
procedaral and coVtent levels) for the current state of the linkage. 
A. high degree of group process skill would be required to conduct these 
sessions. The literature will offer other suggestions, as well. Even 
if the KPU effort is planned to be something entirely new, paying little 
attention the Qurrcnt networks, thi^ analysis is required to get-an 
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understanding of the current dynamics and environment within which the 

effort will have to compete, serve, (and inake' irapr,ovenents. 

I 

' Cor"zent ; If^ ciay characterise the R,D£<D approach as 
"authoritarian, in its stressing oj^^^anned and orchestr^^t^ed effort, aa-i 
on ecpirical bases for solutions; arjd if the Probleo-Solver approach is 
thus'xiore "deaocra^c" or participative in the control it affo^'ds to, 



clients; then, the ^'natural network" 



faire. If the. past, operations of ther natural netwoirks have s^ill re- 
suited in. enough 'unmet needs so that! 



mode might be classed as laissez 
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extensive added activities are con- 
\feinplated, as in the casie of RDx, then it is probably the c^se that many" 



changes would have to be atl:empted to make the natural networks responsive; 
i.e,, they would have to be made "unnatural." Thus, these available fac- 
tors seen best suited as additional comr.unication channels ttirough which 
to publicize the RDx effort, and which may pick up a few producers or 

practitioners who might otherwise be missed; but these networks cannot 

) ' ' ' 

do even a ir.oderate part -of the effott themselvtfSv^ . . ' ^ 

It is important 'to work within t;he many existing networks formed 

among sinllaV people and groups: producer, policy, practitioner comnuni- 
' A ' , ' 

cation nets and "invisible colleges .", Within a given group these will 

' ' • / 

contain^ the most current thinking and ideas, linking the top people, and 

— «• 

will serve as ^ rapid access to group consensus-building about the work 
of RDx. In this sense, then, the*natu|ral networks^ are ctucial, Jbut 
the underlined- reminds us that there are many of these, and that 
there are ij^kely to^be few e^ctensive inter-network linkages. 

One of the natural networks deserves special attention — that 

s 

one linking practitioners in the field. The state*-to-state information 
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and resource .exchanges, Co be coordinated^ by the Regional Exchanges^^ will 
be a helpful entre into these. The solicfi support of this network will 



'o-* provice needed legitimizing of the RDx effort. It is also especially 
inporr/nr to use^ this network in need-sensing and evaluation and moni- 
tfccing. To the extent that this component of the natural networks coaes 
to have an active voice in deciding policy ^nd directions for RDx, then 
the natural network mode woilild ultimately contribute balance, and this 
^ode would* operate in a clie^t-orientcd manner. - 

Perhaps the most ^useful postur^ for RDx in relation to these net- 
works is not so 'much nurturing them in the inter-network sense, as in 
culturing * or" courting each of the many existing networks separateXyl 
Continuous Flow Dissemination (Mode No, 6) 

Description ; The most min:;^al mode in terms of KPU effort beyond 
the natural network could be called "Continuous Flow Dissemination.'* This 
. include^ d is sethi nation in its most traditional and popular form through 
^production and distribution of ^information via one-way, essentially non- 
interactive media (usually printed), ^oth wide-distributipn mass period- 
ical channels and selective dissemination of informhtion (SDI)tare used. 
The "targetting" for the SDI component cbmes^Jrom the interest yand need 
profiles of those contacted in the ma^s media' phase. " A' good example of 



c^s , 



this mode would be the tear-rouf: cat4 contained/ in tecjinical periodic 
through which interested readers select things about which they would 
like more information. The returned cards are" filed for* future targetted 
conitrunications. Note that the need-sensing' component so crucial^ to. the 
fornation of strong linkages* is included here' in a style we might term 
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•"asynchrofUius^d individuaUjjOe;'''? are collected froa indivld- 

uals, and are used to determine what is s.ent' their next (i*e*^ at a latVef 
Doint in tieie). Individuals have no control over what is initially of- 
fered, r.ovever* ^ 

ROx ?lans ; . Operations Support will be invo^lved in publicity ' • 
functions. Newsletters and othei;, broad-circulation publications are 
pltinned, and may be targetted, based pn user needs and interests, | 

Predictive Factors : fhe key point here involves the pool of 
potential linkers: only those who receive the mass media Messages and 
who are interested enough to Respond with profiles enter the SDI pha$^.' 
Since t.he ^nowledge-producir^g component does ^ot enter directly into .the 
interchange, there is little opportunity for reciprocity in the sense of 
affecting the knowledge base itspl,f> though the dissemination formats 
are likely to be influenced by client reactions'* Thus, those forces ^. 
which affect producing systems are likely ta remaih unchanged by the 
effort, while procedural "and cpntent factors may change ~ but only at 
the mediua and format levels, not at the level of the knowledge being 
transmitted ► / 

Comment : It is important4o consider the Vari(5us*filtefs which ^ 
operajie in this mode» First, the mass media must reach the right indi- 
viduals making media selection and design very important activities. 
Second, the individual must be sufficiently "grabbed" by the content so 
as to respond with a need or interest profile. Thus, this mode dofes 
little to stimulate concern and need if none is perceived by. tf?i2 indi- 
vidual or group. Thir<l, the need responses must fall within the scope* 
of the information available now arfd in the future. There is little or 
xio provision here for handling needs or interests which'are, from the 
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disseainator's' viewpoint, out in left field. If a component could be 
adiod which would r.onitor the need profiles, and become an advocate f^r 
tha "left field" rleeds through contacts with policy, program and R&D 
oerscnnel, c'r.en this mode could be used to advantage-*, it could go beyond 
•Sthe "cast^a broad net" approach to catching individuals and groups who ^ 
may not have learned about RDx through t-Ke more central activities, 
rId Produc e Dissemination Service Oi6de 2) 

— ~ ^ 

I Description ; This mode Figure 3 ) assumes the existence 

of a irea'sonab4.e inventory of validated R&D products "on the sheliE," "^The 
problem thus becomes bne of getting them off this shelf and into the hands 
of the specif ic ^educator best able to use tHem, The approach here is one 
of advertising or marketing, seeking ^he best means of publicizing what 
is available, displaying, demonstrating, adapting, packaging, and provid- ^ 
ing technical assistance upon adoption, A^lways, however, the, focus is on 
•the ^prod'jct ; its validity and utility are taken as givens. Reassessment 
of the fit, between ^currenft needs and products is done, before and during 
screening for, qualit;;^. After transformation, both mass triedia and targetted 
channels are used, the latter leading to demonstrations an<^ consultation ^\ 
activities* . * 

[Insert figure 3 about herre) . 
RDx Plans i In the past, mps t- educational * labs s^nd some .centers fol-« 
lowed industry's practice of setting up a marketing and^ales div^on, sep- 
, arate from professional R6D staffs, to handle dissemina!B|(i of their products 
One night logically have assumed that the es tablisKmelft of the RDx'sig- 



nailed, a merger of these various efforts into*a single marketing ojieration. 
It is clear, however, tl\t RDx now is envisioned in largeiT and more varied 



/ 



. foras, covering' several other\operational modes in addition to this. one. ' 
- * Several RDx activities fiV here: "... searching for products, screening 
and- reassessing them., :^nd transforming them for communication or transfer 
to users" ' Th^y [the contractor^] will also assist other linkers i^disseni- 
atir.g';^ products through awareliess activi-ties, demonstrations, direct con- 
sultation, and rt^nitoring" (NIE, 1977). Dissemination is a major part of th 
•work of.Exchanges; for example, f,inding information resour.ces, build- 
ing regional resource exchanges>and adapting and 'distributing .materials. 
The important step of quality scteening will be done by Operations Support, 

while R&D Interprefations will analyze, available products aiill transform 

. ■ • ■ • 

them as needed. R&DI will work primarily in the "high-prioripy" topic, 

/ ■> 
areas, however. , ' • ' 

Predictive Factors: The key issue here i'ftyolves those factors 
which affect accu^tate need-sensing or become active if th6 available R&d' 
base does not meit the "current reassessment of need'.' included eafly, in 
this mod|. First, RDx contains very long need-sensing "paths": practition-- 
ers to linkers to Regional Exchanges and/or contractors to Operations Sup- 
port, and R&D Interpre^tiofis (where quality screening and packaging of 

priority topic information will* take place). » 

• i . 

These two latter groups will, need High organizational capacity levels 
to cope with, we suspect, often competing need messages. Need surveys - 
will provide general and normative statements and priorities; th'e REs will 
report, specific needs of^ individual clients. The resylt may be competition 
between the two goals of working on overall priorities and servicing the 
REs, and their clients in the short run. The REs will probably find them- 
selves handling many of the specific needs locally tp save time.'^erha^s 
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paralleling the work of R&DI; and "this may serve to desensitize KLOl to 
S3r.e ^re'as of need (since they won't hear laudh about them anymore). 

•* 

^' .PerhsDS need processing is too diffuse in'RDx to be able to garner th? 
necessary level of expertise and conmiCnent in a^ij^one coniponent.' 

, If cdrrep.t needs do i>6t match what is' ava^jj^abla* in ttte R&D base, Chen 
R&DI, will be soziewh^t pressured to- move J)eyond the transformation role to 
sj'nthesiza or even create its own relevant knowlb^e^, ^ 

A related issue becomes, thenj how RDx as a whole will influence R&D 

funding policy to alter the knowledge base. "^His is beyond the scope of 

S ' ^ . ' - ' 

this operational mode. However. 

We see relatively fewer issues on the dissemination side of this mode, 

primarily since RDx has been caref all/ tailored to ^include many different 

delivery channels and procedures^ and att^tion appears to have been much 

/* * , 

t ' * 

more on dissemination than on need-processing. Effective coordination 
of the nil;ltiple activities is a -very impprtant issue, however, as is the 
intesrction (vs. competition) with existing services. Most of the impor- 
tant background factors here appear to be organizational, relating to the 
dissemination goals and "territories'* of both R£x component ' organizations 
and outside providers (e.g., ERIC). The ^wo issues interact: a clear, 
coordinated overuiew is needed to affect , integration of services. 

7 Comment: In sumiSary, if less attention is given to need-proccs- 
sing thaij) to delivery, and if delivery functions^ arc diffused among many 
organizations, roles, and linkages, it, may be difficult to see this mode in 
operation, or to trace its effects dt tintes, even though it prob- / ^ 
ably will ^e carried ou&. Current need reassessment i^ crucial here 
and in nany of the other modes ;"^nd plhris of RDx do^ not appear as well- 
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Conned in -^h^ area as an t;he delivery siUe. The multipjfe roles- of REs 
and others r.ay interfere somewhat with this reassessment. Th.e ujass nedia 
function? in this mode will serve as a broad -^net ^to bring in persons nt)C 
in the prirary, identifiable client set, Fin.ally, we-^eed to remember 



that SEAs, lingers, etc. are not the ultimate" cliejit in the 



edu^at 



ional 



change process, '^nd that RDx is heavily committed to and . dependent t>n 
the "intermediate" clients' in gatherii^ need information, fallowing up 
on delivery and adaptation of produc^^s^^^id for "evaluation of impacts.. 

mtimately, given the muLtiple channels in use in this and the other mode's, 

^ % ^* 

it may not be possible to establish clearly the impact of the effort, and * 

^ ' V • . ^ 

this must^.be considered in developing the criteria by whiph RDx is fp^e 

Judged. ' • ' . ^ ' - . ^ • 

Instant RBsponse R&D Retrieval- Service (^lode 4) 

Description ; The'emphasJCs ^lere is on'- accessing the knowledge ^ 
base as quickly and as §ifioiently as possiljle for aay and all requestors. 
Such an approach makes npaxiraum use' of contemporary techrfblogy^such as on- 
line computer searching, telephone access to ^specialists who negotiate 

questions yitli requestors to def ine '^nd^ redefine the request ^. etc. These 

^ " ^ ' , .s. • 

activities are indical^ed in Figure A . IiJ^sucji- a mode an R&D service 

would typically provide infc^rmation only, not peoducts or technical . 

assistance, and the information would be delivered "as. is,", i.e. , .without % 

^summarization or jinterpretation. special packaging »a)& ba:u*sed for 

f requentlyrrequested topics^, rt^w&yer. J^o& a largd^ extent, the ERIC system ^> 

and particularly the various clearinghouses, have ^volvdj^over the yjears 

to proviide this type of service,^ collecting ap^^bfiftfAlng large quantities 
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[Insert Figure 4 abou'.t hero-] 
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of RoD inf ornation*"in print form with remote terminal access, either through 
the clear intghouses or through conunercial vendors. n • 

' RDx Plans : One RDx ambition is 'to provide this type of serviSje ^ 
vicr. regard to educational R&D products, merging the service with other 
fun.ctiior.3 such as training, interpretation, and some liirtited types of 
technical .as sis tance?^^n the other hand, RDx does not wish to duplicate* 
the operations of ERIC; but will provide clients with trainJfeg and ^ 
access to ERIC. . ^ > 



In addition, the Regional^Exchanges will provide regional R&D 
resource centers, vhich operate in this mode in- a limited g'eographical 
areai ^ Marty Labs alrea^ have capabilities for searching the ^available 
bibliographic data bases. ^< 

Prodictive Factors : Since the emphasis in this mode is on timely 
response" through the "hotline" approach the crucia-l predictive elements 
are those ^which particularly affect rapid need-gathering (in tKe fornv^of 
requests), routing, retrieval, and delivery. Key elements thus include the 
skills and enipathetic ability of the operators, and their ability to send 
appropriately reworded requests to the ^est spot or data base. In RDx^ 
this mode will be used primarily in an informal manner in the R^s, so we 
are talking here about the quality and number of interface staff the REs 
will have av^.ijable. ^ . 

Past success with' such operations is a strong predictor of fiitJure use. 
This, implies that (1) the effort will grow around those whose needs are 
welj^covered in existing data bases; (2) that special at ten tio^ must be 
gdvei^to^ doing a good^job on requests from first-time requestors; and 
(3).^ that fami'Iuirity with the \^ocedures on the part o$ the ^j^ent and oper- 
ator i^necded.. Here operator training with simulated requests to test 



• 113 



the process and the linits of the node would be useful, and client train- 

. ' " - ' ^ \ 

?.ng end access aids are imperative^. Also, the more direct experiences 

operacors can have in the field, to learn clients' perspectives, tihe 

better they \'ill be able to interpret requests. Perhaps they misht visit 

requestors later, to follow up the outcomes of^he request. 

Hur.ar. resource banks and expert pools are part of both ^his m6<je and 

of RD:< plans. Past success .an^ f ainiliar;ity with particul'arly good ^rsons 

'^could lead to their becoining over used and over ext^ndeds however. /^Also, 

good people tend Go be busy on other ^things, so there w^ll likely be some 

necessary tradeoffs between, availability and qua;Lity. Client cloieness 

t;o the expert is helpfu*! in establishing these linkages, both in^terms of 

^ - • » •• 

fease and cost of access, alid locil knowledge on the part of the expert. 

Skill/resource banks kept by the- REs thus become very Important. Also, 

"experts*' who are also^ praotitioners will hafve a "homophily" edge; and 

again, this points up a need for REs to widen their 6xpert« bank- to include 

MteJpful and innovative local practitio^nersi Some work will be needed in 
strengthening the rewards and recognition such practitioners receive for 
helping others^ however. 

Consent; This mode is a codipromise of the notion of true client^ 
orientation, since (1) the range of possible help is "fixed" to what now 
exists in tKe information or resource banks, and (2) the client has no 
real ability to influence the coYttents of these" resources. As a re- ^ 
suit there r>ay be no#true linkage here, in tierme- of 'the definitions we 

•introduced in Part 1 . This approach works well where R&D has. useful 
infornation to provide, and where the scale can be kept small and inter- 
personal, at least betwfeen requestor and operator. The regional level of 
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RDx will help control the .scale problem, but we ne^d te realize th?t the-e 

. ^ i 

^ vill be -any requests for which available educational R&D will fail to • 

* ' 

provide sacisfa-ctory answers. When this happen,s, special procedures will 
have: to^be/orought into play, to link the requestpr to tho^se persons or 
reso'urcss vhich can help. 

The Sapi d Response R&D Report Service (Mode 5) ^ ' ^ ^ . ♦ 

I 

Description: This mode is similar to mode four, but with more 
depth and coaposition of respoiises. State-of-the-art reports are tailored 
for each client by "writer-experts." as shown in Figure 5 . - This ftode ' 
places information providers in a far more ^nterpretive and integrative 
role with respect to the knowledge base >User neldT are carefullly 
articulated in dialog with the. service representative, a^d' then become 
theT)asis for analytical review papers which summariz^-'exis ting knowledge 
on the subject, provide interpretation and application suggestions foi: 
^ the particular need' and the particular user situation, and case the whole 
in^a brief, highly readable document. ^ Such a mode places ver^ high de- 
mand on the skills of specialist-writer-dialogers,' and assumes a reason- • , 
abl^ backlog of good research knowledge on the topjic. It has the unique 
advantage of providing users with concise, absorbable, and , carefully 
thought-out information in a ^orm wTiich is reproducible and -widely ' 
disseninable within the client system. ' Thus, this mode has special value ' 
as a service to decision-makers in high positions =who riot only have' a 
nee^ to understand, but a need to justify and explain to much larger 
audience of staff; parents, s.tudents, and constituents.' It is thus not 
{Insert Figure 5 about here] . ^ 



surprising that this n^dfe has been most "successfully "realized in the 
Congressional Research Service, which provides on request rapid* (two 
weeks naxi-^cr?) , substan^tive, interpretive,, balanced^ and brief reports 
to all seni»co;;s an.d congressD.fen on aiiy subject. In large part, this 
mC)de d'o^s ptaif work for its constituents, and It is not surprising 
tha^ it is fostered' in situations where the clients have high levels of- 
pouer and resource's, allowing them to tailor the information interpretive 
servic4^' to- their special needs. 



RDx Plans ; High priority areas will be given the level of attention 

\ ' * ^ 

to the topic topical to this mode., particu^^arly in the* reviewing and 
S)jnj:hesizi;4 functions*. Interpretations will work on thes(e priority ^ 

areas* ^ailoring may be a bit less precise, since there is no small and . 
vocal client group, but father, a normative pictutNe o'f jihe needs of larger 
groups of clients at a further distance* Certainly, when the prodOcts 
of the integrative/interprdt'ive effojks are ielayed by. RDx*to top decision- 
makers, the effort' will b© operating iri tliirmode more closely (in terms 

\ % 

of relating to a small and powerful ^lientJV. i 

Pr.edict^ve Factors :^ This mode contains mechanisms for polip^y review 



geared to ejecting future R&D* The issue ^is, then, who in RDx willjbe 
involved in this- step? Possible role eonf.licts exist if the same indi- 



viduals or groups operate in thi^^^de-^ in respect to policy-making clients, 
while ^t the same* time prodticing materials for practitioners*' lln generai, 
however, v?e .do not se^ that RDx will operate. in this mode to' any great 
extent, and certainly very little ia-re§^»ect to practitioners^ — the 
power relationships are j[iot aet^p to give practitioners the kind of' 
control amd^leverage over the •conduct of this work which this mode needs* 



In the sense that the work of R&DI in producing interpretive and 
integrative nuiterials -eared fcMT clients falls into this mode on the 
prc^c^ccior. side, there are some' additional predictive issues which er.erge. 
Firs:, rh-re is the factor of distance of the expert-writer froa the 
practiricr.er clients; this may introduce interpretive difficulties, un- 
clarity abcut media and presentation factors, etc. We suggest strong 
procedures to get writers into the field to increase their knowledge of 
needs, uses, r.edia preferences, language, 'etc., The^ ability to acquire 
^this kno-./ledge of practitioner clients may be reduced if R&DI moves into 
this mode in the sense of communicating for central policy-ma^cers, 
Secorfd^ ^there is the issue of how to define priority arpas to receive 

■t 

chi^ detailed treatment. R&DI iT>ay have capacity problems in trying to 
do too man- topics, but this is countered by^ potential client perceptions 
of irrelevance if too small pr too broad a set of atopics is chosen. 
Need statenents will have to be normative, rather than individualistic 
(as is the'case with powarful clients). The only good way to -^et client 
acceptance of normative needs or "committee" priorities is -to publicize 
the whole priority-setting process early, so all can see the outcomes 
later, even if the particular product is not directly' relevant to needs 
of sonie specific individuals. As long as clients' know that the process 
is an iterative one, with new priorities chosen for the next .sequence , 
they will realize that they have a chance to hav^|^||^r needs served 
later. " 

Connent: RDx, thon, has some -activities which can be identi- 
fied as falling in this mode fro.n the standpoint of the interpretive ' 
process; but it has no clear plans to operate in this mode in respect 
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to deiision-naker clients at top levels. It is unclear whether this 
mode can truly function if the client group does not have th't type of 
control and power that, say, a Congress has over CRS, It isVdoubtful 
that any practitioner clients will s,ee the work of R&DI as^"staff workV 
for then, given th^ational scope and normative need approach R&D will 
have to use in deciding on topics for work. Much of the attention of 
R&DI should go, therefore, to field Unkages and pub li.<rlty which will 
increase perceptions of openness and service. 

Because of the attention to d^ail and interpretation, this mtfde 
Is an expensive one to operate for specific clients. The expense is 
partly related to the amount of client-tailoring, and partly to tKe 
investigative nature of this mode which alloys writers to move beyond 
what is provided in the R&p. data base. Th^s introduces the is^e wMch 
IS at the heart of most KPU efforts: the /cost/helpfulness ratio." ^The, 
most helpful solutions are those which sfre specifically tailored, worked 
out in close interaction with the client, interpretive 'and procedural. 
This is costly. Most KPU efforts put great energy into simulating this 
kind of service dn a larger scale. About all we know about this ratio 
is that it is there, however. There -^are no studies which look at the 
KPU problem this way, or which compare and 'evaluate alternative methods ^ 
which have been or might be used. 

The Coor dinated MissionHJriented R&D Program (or P^roject) (Mode 1) 
. ^ 

Description :^ This node represents a specific response by a par- 
ticuLar R and/or D team to a specific practice or user ne-ed- ( Figure 6 ), The 
project might be large or pmall and might occupy a time frame as «hort as 
Cinsert Figure 6 about here) 
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six con^fis or as long as six years; Che imporcaiit point is that this repre 
J sents a closed svsten approach, typically specified in a contract with 'a 

♦ 

gcvernsent agency defining the terms of the contract, to include how the 
results c: the oroject are to be cominunicated and impletnetjted , by whor. 
and for vhor.. * 
^ This Tzode can also be used in smaller efforts, when cli'fent, need, 

and providers are. well identified and closely linked; In both instance's, 
houever, the emphasis is on the quality of the R&D product (frequently 
because the stakes are high), and on high relevance" of that produot. 
Examples of this mode would be the pilot experiments on tl}e negative j.n- 
corie tax, rent subsidies, and "Sesame Street."'. 

Because of their national visibility, high news value, salience of 
the need, and the specif ic'ity ' of the solution, utilization of findings 
frozt these Studies is often not deeir.e4 to be^ a major problem. Changes 
resulting froni the'se efforts often come mote through .administrative or , 
•legal enactment and/or eitforcem^nt than thrpugh voluntary^adoption anotig 
. l«wer-level clients* 

RDx Plans ; The Regional Exchanges will collect and repprt needs 
to R&D policy-nakers , and so RDx may Have inputs into these efforts, but 
this is (to quote NIE, 1977), "not within the purvue of the R&D Exchange." 
It is difficult to tell, however, whether this posture is reacting to-, 

ft 

the scale or ^cope often implied in this mode, or to the''t/pe of relation- 
ship it creates between R&D and client. We would hope it is to the former 

Predictive Factors : Given that this mode is primarily beyond ' 
the scope or interest of RDx, the primary issued here relate to the role 
of RDx in feeding forward the needs of practitioners and linkers to edu- 
catior.al R&D policy-makers who are involved in the large, visible R&D 



efforcs- This na^rrows dom to> an analysis o'f those factor.s affectirg th3 
ab-^^itv 0- Che Regional Exchanges to collect need inf o rfnStion , and of 
Operations Support, contractors and RDx policy-Etakers to relay t'hir> to 
broader er.ucational R&D funders, prodircers and evaluators, 

We need to begin our analysis by noting that there already is an ^ ' ' 
existing, though looscly-conf edtrSated set of actors and^rocedures through 
which major R&D efforts are created, .carried out and disseminated, RDx 
will „ thus be entering a populated arena, oitg in^whici^the 'antennae" 
scanning for need stiitenients are already recely^g a multitude of (often- 
competing) signals. Further, the existing R&D,fun^ng organizations have 
icportant constituencies: (1) the R&D copunity- f uhd^ by theni; and (2) 
the policy and program coMunity which develops and irfoleinents thetn. ' ^ 
Each group h^s a high stake, in the current policy /R&D m±±. RDx will have 
to work, phen, in alow-key, largely interpersonal mode at first, espec- 
ially if need-sensing reveals impcrcaut areas which past and current R&D- 
policy and findings have left untouched. Interpersonal contacts with 
important R&D policy' and educational reseax:ch groups are important in 
gaining support, assistance and an active audience, and to avoid RDx be- 
ing seen as a and intruding force. There is always the ch^ince o£ . 
"data shock" in area/ where policy has been raade in the past in the absence 
of 'empirical -rleeci and effectiveness data. / 

There are also, certain organizational sn^othings needed at the national 
level, since, RDx's role in need-sensing will overlap with the as yet un- 
c^peracipni intent of other portions of MIE to begin an educatioaal need- 
sensing and nionitoring effort,' This group dvxd RDx will need to coordi- 
nate the?r approaches toward R&D policy'^nd funding sectors, so as to speak 
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for clients' needs with as concerted and -organized , a .voice as possible. 

The inoortant organizational factors ar^, therefore,, cohes^veness, open- 

ness to other groups, effective participative goal-setting procedures, 

and coordination ability. 

Operations Support and contractors will also have to link to the NIE 

-corponent. This will require high sensitivity to and knowledge of the 

R&D policy-aaking sector, backed up by valid needs data from groups wider 
than the direct clients of RDx (who are not reatly typical of, nor per- 

haps even well linked to, the less-innovative and much larger^et of edu- 
cational practitioners). " y 

There are also strong content .and procedural factors at work here, 
since many of the larger miss ion- oriented projects and programs are not 
so much geared to providing deliverables for practitioners . as to affect- 
ing the conditions and resources with which practitioners work. Thus, 
the effects may be indir'ect (and hence in the.^Jrong terra difficult to 
identify), and <the user group for these projects may be indistinct as 
well. For exgap'le, a large action/R&D effort In compensatory education 
mav produce new funds and laws, 'not new educational materials, and these 
must then filters down to the practice level. Jn ^the ^eantime the needs 
data would show l4ttle dhange^ in the situation* ^ 

Need-sensing must also meld with evaluation. Ultimately, a good 
tes^ of program effectiveness might be reduction in need statements in 
that area (though there is always the Q'ounter-explanation that needs 
have been changed rather than met). Evaluators, many of whom come from 
academic/theoretical bases, may be more accustomed to designing their 
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criteria based on professional grounds, rather than on statements of clien 
neecfs. Scjzie careful work will be needed to overcone large perspective 
gaps, or to at leas.t educate evaluators in core client-oriented directions 
' The general nandate and procedural details for handling needs which 
do not lead to* R&D programs appear unforced in RDx planning, and this 
may bloc':^ the pr<y:cssing of such inforcation. On one hand, RDx has 
neither the capacity nof interest to become the^du^ational equivalent of 
the Statistical Reporting Service, covering the condition of the educat- 
ional crop and its problems; but we still cannot assume that R&D is 
needed to^ respond to all (or even most) of the crucial needs in edu- 
cational practice. Powerful policy-makers may even request wider need 
assessment x)nce RDx demonstrates a capacity to deliver any valid and 
tinely need data at all. Policies need to be developed fco define the 
limits of need information which RDx will collect, and procedures need 
to be developed to begin forming linkages with those who deliver ^solu- 
tions not based on R&D (e.g., funds, reguLations, etc.)* In sjettiW the 
linits on RDx need-sensing, it is crucial to remember that, in asking 
anyone about their needs, it is illusory to ask only about those {ihiiWs 
we are interested in providing. necessary to provide the contexV<|i 

for inf ornational needs, for ex^ple, by contrasting them against other 
need areas,. • 

Finally, the need-sensing capacity of RDx mupt be questioned. The 
effort appears to be placing much more attention on delivery than on 
sensing "needs or "feedforward." Solution development , and deliveify tefTj^ 
to follow Parkinson's law, expanding to fill all available tij^iejand 
capacity; and this ,is especially true once providers get lirtked to clients 
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Emerging strong and useful client, linkages may then tend to eclipse col- 
lectin-g needs daca and linking, these,- beyond RDx itself • 

C-rj^an:; We ^ree that RDx should not itself operate in this 
noce Gireccxy, iri the sense of larg^-scalp R&D.efforts. There is some- 
thing to be said about the value of operating in .this style in relation 
to clients on a snairer scale, however, and RDx should explore this 
furiher. The whole need-sensing or "fe^df onward" function requires as 
much^thought as the solution delivery components; and this function is 
\ particularly sensfitive, given that the audience consists of R&D funders, 
hUg^-level policy makers, and the political arena. I 
Ad Hoc User Research Services (Mode 7) » 

, ^ Description; This mode (shown \in Figure 7 ) is similar to mode 
one on a minute scale; and is ^similar to /lode three with emphasis on 
original research on Che client'^s specific need rather than search\nd 
retrieval of information from other sources. In this mode, the outsi^ 
resource person is essentially selling his/her skills as a researcher, 
or evaluator. Relevance and applicability^ can be assessed if the client 
collaborates with the resource persq^n on defining the need, choosing 
instruments and design, etc. Ideally, this mode can proyide results in a 
reasonably short period of time. Labs and Centers are well equipped to 
^provide such servicesif their staffs include individuals with good 
linkage and h^lpingj^^ls, in addition to research comp^etence, 
(Insert Figure 7 about here] • • 
^ The two variations, "ad hoc user research," and "user-collaborative 
Rto"- differ in the styl^ of involvement of 'the client in the process. 
In the forrer, the client sponsors the Rfi^but, may truly become a ^ 
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"clienc" only when .the results begin, to cor?»e in. ftany marketing a^d 
organizational studil^s fit Chis style, ^ollaborative R&D keeps the 
client involved throughout the process as as full a partner as the clientz's 
(er.erging) skills perr.it. Action-research is jhe npst collaborative forr. 
of" this style, with the client involved in all phases, fron problem def- 
"inition through trial change and ev^uation. This requires a high degree 
of openness and effort (see, for exanple, Lingwood and Morris, 1976). 

OnGi example of a variant ^of this node is provided by the system in 
use at the ^^aval Facility Engineering Co*'amand, where researchers rotate in 
haadlihg questions and may do simple research requests (up to $500)^ 
for each requestor. Of course, this ^s a *"hard science'* '?arca in which 

there are actually many inportant questions which caa be "researched" 

\ ^ 

for unJ.£r $530. The contact person is a researcher, and this cakes a cracial 

difference, both for the quality o% skill put ihto^solving the problenp and 

*9n^for the training researchers get in handling clients' needs. 

# - ^ • * ^ 

R3x Plans : "Ad hoc R&D in response to particular practitioner's 
requests cannot be part of. the R&D Exchange*^ (J^IE, 1977).' Certain ^ct~ 
ivities of the Regional Exchanges may lead to this, especially a^ resource- 
persx>ns are linked to practitioners, but the Exch'aqges will not themselves 
be active throughout the process. 

Predictive Factors ; Since we ,feel there are some aspects'^f ,this 
node which could be important even though RDx does not see this as a part 
of its operations, we will explore the predictive factors to a moderate 

' / ' ' ' ■ ' * 

extent. It is also inportant to u-nderstand these factors if RDx is to 
act as a broker irv; lintcing practitioners to this kind of activity. 
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Direct interaction between clients and iesearcher^ provides useful 
training for^both sides: practitioners learn to be more analytical and-^ 
purocseful, and^to base decision-making oq emprical knowledge; R&D person- 
neriearp/hov to be r?.ore relevant, and have their ^otfcepts , methods and- 
analvtical skills tested against the ultimate validity of real-life use. ^ 
Cor.?aCibility between researcher and client on societal, organizatiopaU^ 
and individual factox^makes this possible.^ Societal forces at the distk- 
pline revel pr^cdndition researchers' entry* into this 'node; generally, 
inter disciplinary, researchers are more inclined (and perhaps, given . 
the fact that'^real problems fit no clear disciplinary boundaries, mo^e > 
able) to operate in this mode. Organizational reward systems for the 
researcher are key elements (again, see L'ingwood and Morris, . 1976) : if' 
researchers are not supported for "applied work," they will not do it . 
— at least, not after they come up for prcr.otion or tenure. Since the 
societal and organiza^Tonal forces move more slowly than the researchers - 
cher?.seives, it is offen the case that private R&D organizations (both 
profit at^ not-for-profit) will be rao^e amenable to^ working in 'th^is mode. 
Some such researchers, however, trade off me tjio do logical rigor for personal 
.concern with helping people, A more fruitful appro^ch^nnOds that-^^olid 
concjeptualization and method are more important in real settings^han i>n 
artif ically-contrived ones. ^ , ^' , 

This mode requires a high level of interaction between researcher 
and client, since both will have many unclarities t;o resolve and much to 
learn about^the o^her. ^n the case of RDx, t-his translates to providing 
' practitioners with resource banks containing researchers in the lo.cal 
area. .TheREs may be drawn into this mode more/than they would like, con- 
sidering their other duties. Issues of capacity and internal Lab and 
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Center cocn:unicat|ons 'become important here — the latter in fij^iding 
others In^the organization who ^cbuld help tne particular client if there 

' • ' ^ : . • • . ^ • . 

are* no available or relevant outside resources. ' * 

Corr.ent : If the Regional. Exchan^s become active b»okers, u«J.ng ' 
the regional resource files to link practitioners with researchers, the • 
,RDx effort will have to act to shape the predictive forces discussed 
above. Beyond keeping ^iles on researchers wi^th good applied track 
records (not necessarily the' same as the theoretical or academic ^track 
record,, by the way)^\RDx will need to bolster the reward systems and 
recognition researchers receive for such workt Recognition for praci^it* 
ioners who become involved is important, too, and these clients worn .be 
pox^erful forces within practitioner networks in diffusing both the- out- 
cc!?.es the^' achieved and the process used to ^Vekte-them. Perhaps RDx 
could sponsor a series of awards, through both practitioner 'and research 
associations, f^r, high quality and Oseful client-centered R&D as a means 
of affecting the societal and professional predictive forces. RDj^ would 
also have to play a role in^^«ry-level training for^ practitioners par-r 
ticularly, and to some extent for researchers as well. Practitioners 
t need to operate in new way3 in this mode: high error tolerance, ahfility 
to engage fn honest organizational sel'f-scruf i'ny , how ta understand a 
researcher and pull him down from the theoretical, ceiling when needed, 
etc. 

"S. 

The i^Qvledge-Based Problem-Solving Consultation' Service (Mode 3>* 



!:onsultat:i6n' Service (Mode 
|ure_8) Is ^l^^«^&^ent .vogue 



Description : This mode (see Figure 8 ) Is ^ri^«^&^ent .vogue among 
educators. The emphasis here is on prov^^ing very personalized setyice 
tcf specific clients, based cjn the client's needs and concerns, whatever 
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these nav he. This mode then does tiot limit'itself to "^R&D processes 
or prpducts. The mode requires the presence of special knowledge or 
chang^ .^gencs or linkers v;ho can entdr into a dialog w-ith clieftts about 
needs a\d potential solutions. The linker needs to have easy and rapid ' 
access to 'outside R&D and'^o^i-R&D solution (e.g., educational practice) 
bases. Pilot experiments with this sort of system (e.g., Sieber, Louis 
and Metzger, 1974) show this mode to be beneficial and appreciated by 
clients on one hand, but extremely costly to implement on the other. 
(Insert Figure 8 about here] 

Clients' needs are the controlling factor h^re, not what the linker 
or intervener wishes to provide.. Again, R&D information is onlyone of 
many bases which may be s'earched for solutions; and R&D may be used last 
of \ll, since greater translation and adaptation is usually needed before 
R&D can be applied to problem solution, compared with other solutions 
such increasing capacities, getting political support, etc. 

RDx Plans ; Regional ExcKanges will perform some, but not many, of 

these functions, with support of the national contractors. Many involved 

j 

in the planning o^ RDx have expressed a distinct preference for this mode, 
even with the high costs involved per client contact. 

Predictive Factors ; Thrt^ factors appear to limit the ability of 
REs to operate in thj(s most cll^^nt-centered mode: (l)^the limited level' 
of support for full client-orientation, such as, moving outside of the 
R&D or even informational realm (note that these activities are "optional'' 
for the REs); (2) the skill and capacity base of the REs themselves; and \ 
(3) the need-filtering system v;hich may operate between REs and clients. 
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Firsr,, RDx support for such work is likely^to depend on tha e:<tent^ 
to vhic;:. "s^Dlutions" derived relate to or coTr,e from educatipnnl R&l). 
Again, V5 r.eed to note that this rr.ode > assures that KID may have linittd 
' p,' relcvar.cs at* best to na:iy client need stateaients, and th^it in any ca^e, 

lin'.-.agas are not well-for-.ed by forcing the client's interests into any 
one nold. RDx's level of support might be higher were the system to 
view this mode as an important intelligence-gathering activity — to find^ 
out where clients really are and the broad scope their needs may take; 
with the added plus of sonie products which may be useful elsewherei 

REs may decide to opt out of this optional activity, -especially if 
/' • they are spread thin and kept busy with more central RDx activities, 
^ Or.e of the crucial fcir.ts of this mode is the labbr-intensiv.e character 

of work with clients. RE leadership also will have to exert guidance 
over t'lose froni s,taffs who do become involved in this mode, sinc^ 

there is a tendency for "action people*'^not to record their approaches, ^ 
^ skills and learnings for others to use. They tend not to write because 
puSlication would make their successful approaches p^ublic, and hence 
not exclusivel\^ theirs in ^xhe competitive action market; or because they 
are sir.piy so concerned with helping the next client that they cannot 
. find the time to reflect and write. r ^ - ' ^ - 

finally, the fact that RDx's prime clients are. not practitioners,, 
but rathar linkers who serve practitioners, may set up sotne blocks or 
filters between RDx and. true expression of' practitioners' jieeds. The 
"linker clients'* are most often persons whose in^rests ^nd job des- 
^ criptions relate to dissemination and use of.'R&D, They may not be in 

a position or have the interest, to collect needs which do not relate to 
RSD solutlrns. RE activity in this mode, or in setting up this mode 

: ER^ ' - 134 ' - 
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through outside resources, m%y overcome any ^las In'bhl s ' aTea' : — " — 

Conuner.c : The optional character of) this mode of operation, and 
the strong possibility that it will move well outside the realm of R&D, 
icake the ^successful use of this approach very problematical in RDx. 
We feel that RDx needsjto. be aware of what these kinds o£ projects are 
lea^^ning and saying, however. The support and start-up role of the 
REs is even nore important here than the previous mode, ho'vever, 
exactly because this mod^ is more "action" than "research." Agafn, 
the costs are very^high per client reached in this mode, and this sug- ' 
gests that RDx link to these activities indirectly, hopefully without 
having to cover many^ of the costs involved, 
SUMMARY OF THE OPERATIONAL MO DES 

These eight nodes represent tremendous variety at all stages in sensing 
needs, development of linkages, delivery and implementattoii. A graphic 
summary of this varriety is shown in Figure 9 , Again, the modes are^ listed 
in ,order according to extent need-sensing and client-rorienta'tion . It is 
instructive to compare that happens in the other columns, particularly on 
the producer side, as attention to clients' needs increases from very, low, 
through nornative, to individualistic. ' ^ 

(Insert Figure 9 about here] 

>s 

Perhaps the most important are the planning and centralization 
columns. These start out- very low, since the KPU "effort" its'elf is usu- 
ally peripheral or tangential to knowl^ge^toduction in the first two 
modes. Planning and, centralization reach their peak somewhere in the 
middle, when large-scale efforts are planned to reach dissemination ob- 
jectives; need-sensing is in the individualistic mode here, but, the clients 



a^e still ill a position of low co^^rol oyer what they get frocPthe effort. 
MhQti clie-^ts- exert control over both form and suSstance pro\?j^4ed by the 
'effort, planning and centraliza'tiOn are,,reduced ; or', it may be that losver 
planning ?.r.d centralization signal an op'ennes.^ which permits clients to , 
e:cfert more influence through'out the linkage process. Cost is not shown . 
in Figure 9 > but it generally, increases per client linkage as we move 
from top ^o bofc^om 'in the figure;, however, the clients become mo^s^^. 
active iir covering their own costs in the** bottom modes. ^ . ^ % 

Can this ordering^ nodes be considtf-r'Ss^ a developmental sequence? 
There is n<J simple answer- We believe there, is a general pendency :to 
become increasingly open to clients' needs and participation ir there is 
a central mandate that the cf fort hajve ^^fr^e^l^ct^n the clie^it, but if the 
clients resist j^he eflort. Income (iases, after years, of unfruitful ^ ,^ 
attempts to get/"users" to actually^ make use^of.R&D, ^the KPU staff 'say, 
in effect, "OK, we give up, what is it you people really want?" We\r\^ 
at even in education the push for need-sensing grew more tharf a ^^p^^" ^ 



af t»er establishment; of major^^^seminafcion activities suc^ as ERIC. 

Figure 9 masks a relevant and important . consignation, however: ^ . 
as we move toward the bpttora'of the figure, where the participation of ^ 
each client is greater, there are actually fewer client organizations 
who -ever enter that mode in the first place. A winnowing out takes place 
between the delivery-oriented and the client-oriented modes,, with only 
ttte most opened innovative clients moving into modes sejj^ and thcee^ ^ 

Thus, seen from the oroducer^s side, this sequencing of modes usual|y 

<^ . - ' - . 

is not a developmental sequence, sincd|so many of the potential client^ 
v/ould drop out along the way. From the perspective of the inrtovative 
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client, however, there probably is. a developmental sequence, as the 

organization becoces sensitised to the existance and then the limits of 

R-j^Telated resources, and finally brings the empirical approach in- 

housc so as to get more out of it. 

SUMMARY 0? RDx LINiCAGE ACTIVITIES 

In our presentation of the operational modes we identified many of 

the linkage activities of RDx. It is useful to pull all of these plans 

together/ however. Figure 10 lists those^^ptivities mentioned in. the 

NIE solicitation (NIE, 1977) by rwKich REx will make contact with its 

linker cliBnts. We have divided these into four levels: national and 

regional exchange ^ievel, and in each, H&D- and client-oriented., This 

coding is based on our judgment,, of course, and is open to discussion 

— preferably discussions between RDx planners and prospecti^ clients. 

[Insert Figure 10 about here] 

^ There are three kinds of flows relating RDx to its clients, illus- 

trated^by the directionality of the arrows in the Figure^. Some'^flows are^ 

deliveries of information, skills, help, etc.-from RDx to clients; other 

arrows capture flows from clients to RDx, with needs and requests for 

help being the most important; finally, there are bi-directional arrows 

which indicate partnerships or mutual influences (perhaps true inter- 

.« 

personal Tinkages). ' • ' i 

A- 

/ First, we note that almost all of the connections exist at the Reg- 

ionaL Exchange level. This illustrates the '*front line with support 

troops'' model built into RDx. The REs serve to buffer between 'the clients 

!and the R£fD- and client-oriented functions of the effort at the national 

level -(e.g., contractors), so there are many information flows between 
r 
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the REj^ ar,d the support functions which we have not sho\m in the Figure, 
This brings up the issue of potential overload, however. V;e say the same 
thing in the early 1^70s when (then) OE was developing the design for 
the educational extension agent concept. There was general recognition 
that the real powe^ of the effort was in the* direct^contacts to be 
developed between the agents and practitioners, and thus, all important 
functions of the effort as a v^le werp channeled through these people: 
need-sensing, training, solution delivery, performance monitoring, etc. 
There are severe dangers of overload in this style of operation which 
may confront the R£s, as well, ^ Almost all of the national-level funct- 
ions ^ch^ann 2 1 through the REs, andN-zk^le, this fs probably good from the 
clients' perspective (having .only one source to deal with), the REs may 
have so many things to do that direct services suffer, '^■1 

The second thing we notice in the Figure, echoing what we saw in 
the discussion of the modes above, is that thete are many more .delivery 
arrows than need and request arrows, even though^we cannot simply count 
the number of either. The many different delivery arrows represent 
alternative ways of reaching clientfsJrTkome cases; and given the number 



of these, we hope they would be applied selectively in o^^er to best 
matc^ nee^, content and media preferences, etc, -The princl^^e /f 
redundancy is another reason there are so many delivery channelf^too: 
any one means may miss the target. This brings up the question, Koj^ever^ 
of why there is no redundancy built into the need-sensing and helpr 
requesting channels? Since so many of the ^eed-sensing* activities chan- 
nel through the REs, there is special* danger/^thefh >being lost or bur- 
ied if the REs become overloaded or busy with delivery and/or the need- 
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sensing activities are seen as optional in any way. The also need 
the ability to serve as redlrectors for needs which are outside the 
scope of RSD; this implies that REs will need to know the most likely 
sources of information and help in many other areas of education. T]he 
REs will have to fight the tendency to interpret every need or request 
in terc^s of R&D. The "law of the instrument" applies to service efforts 
especially: it is very easy to see the thing you, do best as the solution 
^o ev<?ry ill. 

Client participation in ?J)ii planning and management is another 
. issue« since there are no clear flows leading into this process. Clients 
need to have an influence in order to* keep the effort balanced and to 
feel they have some rfeal stake iij its success. Participation is also 
the key in helping clients see the overall operations of RDx, since 
many of the activities are, by themselves, only parts of linkages, and 
the total'pattern of linkage is visible only at the large scale. Clients 
need to see that the needs coJLlected from them have been channeled into 
national RDx activities such as priority area definitions^ influences 
on R&D and policy, etc., and that solutions will be forthcoming in the 
future. This awareness will highlight the need to be concerned with 
fut'ure n^eeds, so that solutions will be ready <wh en the needs'become 
real (e.g., implications of scarcities of energy for school integration). 

Before any needs assessment or participation can be planned, l)ow- 
ever, any KPU effort needs to have a firm definition of who its clients 
are . Client definition is crucial in RDx, particularly as it affects 
the relation of RDx to the ultimate client, the educational practitioner. 
Capacity problems limit RDx's ability to raov.e much beyond the "linker" 
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client, yet we have, mentioned sev^al issues in which thg liij;j,^r^per- 
ceptipn of needs and their delivery capacities are crucial. There is ^ 
the danser of the following vicious "circle: (1) linkers may see their . 
. roi^ as helping on problems on which R&D has something to' say; (2) R^x^ 
determines ne;iis of these ,linicers in terms of needs for A^R&D; (3) 
new R&D is aade available" on these topics; and (4) the Information is 
delivered to linkers, thus narrowing the rang'e of topics on which /s^ 
they have the most recent information. To break this circle linkers 
Will need to' be exposed to a wide rarlge of' practitioner problems; thus 
they will have to.be well integrated into the total range of services 
and perspectives within their oL agencies. This wiU also help them • 
filter off needs whi^h other components of their organization can dek' 
with .more efficiently. 9 

There is also a great need for validation data on the needs for 
and impact of RDx. At one level there is a need to check on ne.ds as 
identified by HEs. linkers, need-sensing .surve'ys. and the practitioners 
themselves. All need-sensing should begin by asking about problems . 
not just needs for information, since this is the only way.tb keep the 
importance of information-solutions in perspective. ' ) 

Illustrating this latter point is an issue which is somewhat beyond 
the control of RDx. but which- will affect the effort nevertheless. This 
is the notion of R&D as the purvevSr of 'Wre" rather Vh.n (caplan. 
in press). R&D information concentrates on the new/ curriculum, service 
programs, teaching concepts, facilities, etc. Yet." 'American education 
is in a period in which it must struggle simply to keep the old. A one 
week scan of our local newspaper reve^d three school districts which 
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were imposing budget cuts as the result of millage vote failures', or 
Which were attempting to restore p4st cuts through second, tshird, or 
even fourth cillage elections. The cuts covered the usual frightening 
range: teasfving positions, vocational education, pre-school math and 
reading, library clerks, programs for the gifted, athletics, transpor- 
tation, computer-assisted instruction, electives, etc. In other areas 
taxpayer "revolts" have closed schools completely during parts of the year 
or have forced returns to the basic three Rs. The key. question ^rs: how 
can RoD in education, and hence RDx, be helpful to educators who are 
facing these crises? How can educators think about "self-actual\^zation" 
when they are struggling with '^survival"? RDx cannot deal with these 
problems directly, or lose sight of its original objectives; but It 
canrtot ignore these pressures at the practitioner level; and if need- 
. sensing efforts do not uncover the precedence of issues such as these, 

V^'- ' ^- / 

than we would suspect tTiat the need-sensing is not probing beyond the 

* # .* 

sometimes trivial questions of "what information do you ne^d?" 

These issues are not the only ones we have uncoveted in our analy- 
sis, but they are central ones from the linkage perspective. There are ^ 
also some important comments to be made from the vantage point of the 
• predictive model, and we will cover these next* 
SUMMARY OF RDx AS SEEM FROM THE PREDICTIVE MODEL i 

Here we will look at .the crucial background issues affecting RDx 
at each of the predictive levels in our model. We Will have to violate 
the model by talking about each of these separately, however. We will 
begin at the broadest level and then work to the specific, as does the 
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Tha Socio tal Lev el 

«crr oxisr^ betweon conpet ins' societal frctors: the pu!.h ((xT achieve 
r.-.ore brr.g for the Ri.D buck on one hand, .and pressure of a tight eronony 
and cor<^?rv;n:isn on the other. The pre!<-.(;nt sltuarton into which ?D:'. 
will ert--- rav be the result of tire cycles in R&l); the current proli£- 
oration of !?5<D products is the .result of many studies- begun in the more . 
flush tin-.es of the late 1960.s./on the oth^hand, educators are suffer- 
ing the consequences of the. most recent recession, the declining birth 
rate, and taxpayer unrest bhsed on continuing inflation. The time cycL-s 

feach of these issues, yet they reinforce eac^ other, 
ietal-level bioriiythns,^ making the task of RDx mere 
ompounding. 
. econonize issue may nean that RDx wilM?ave to work 
e the practical, cost/benefit relevac\ce of R&D; aftd 
derlles our' concern that RDx not limit itself only 
Practice innovations deal'ing with how to cut costs, 
get ffitllages approved, etc. riky be miich more important to many cflients, 
and can. serve <rs useful topics for, delivery , opening up the linkage , 
with th»t client for later messages based on R&D. 
The Organizational Level 

Leadership com^iitment to KPU activities is crucial to their suc- 
cess, at both the producer and consumer end: leadership encouragement of 
applicatloJfs-relevant R&D on one^hand, and Readership concern with be^ 
ing i'iIIim?Sttv%--oiw.*4«-^^ There" is no one R&D organization 

which will be involved with^RDx, of course, since educationaKR£.D is 
spread through the acpdemic, public, and private sectors.^ About a^l 
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'rOx ifakdo is to\work ac/ively for recognition of uje£ul R&D products 
afid the ihdividuals/<rho, pcoduce them. The reward system issues we 
nentioned eatliei/are thus important for work ^ by RDx: special awards, 
publicity. fcyw^tribut ions, incentives to academic leadership, etc. 

iTe practitioner side the issue is evgn more important, but is 
more difficult tp resolve. c4.e approach is simply to work with the 
most innovative practitioner organizations, and then to use these as 
demonstifation sites for others — fighting the "not invented here" syn- 
drome as you go. Good cost/benefit data will be needed as part of 
any deraonsti^tion effort^ It may be, however, that it is the organ- 
izational precondition which leads to use of RDx products, not any 
appeal or persuasiveness inherent in the delivered product itself • 
If this is the case, thea the strategy for RDx is not so much to con- 
centrate on proving the product, but in finding those organisations 
which are ready for change, and in trying to make modest changes in 
this readiness. 

The Individual Level ^ ' , ^ 

Given conducive orgatViTjitional climates and conditions among pro- 
ducer, disseminator,*" andyconsumer organizations, RDx must then form 
active linkages with the best and most promising people. It is some- 
tl-nes difficult to find the right person initially from o.utside that 
person's organization. On thfe practitioner side, the past ej^f^erienccs 
of the REs will be helpful 'in identifying such persons. But these 
experiences are likely to be tied into that person's effectiveness as 
a consumer, not as a need-senser. It may be more difficult to find 
persons who have accurate assessments of needs. Much earjLy attention 
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of RD:< inay^have to. be. placed on training and developing a group of 
field contacts as good need-sensers. 

The linker client is the narrow point of contact between a large 
set of practitioner organizations on one hand and a large set of re- 
sources (which RDx will tap) .on the other* RDxr roust thus monitor the 
capacitie^s and burden on these filters/gatekeepers. Overload will be 
* a problem f or the linker cli'ents » 

Individual skills on the RDx side are also important, as we have seen: 
openness >,to client input, linkage process skills, knowledge of resources 
in education, attitudes and values favorable to service roles with clients, 
-etc. 'Top leadership in RDx should also check their behaviors against those 
characteristics of effective leaders identified in Part 1. 

I 

^ The Procedural Level 

' ^ A great deal of freedom "lias been left to the individual REs in how 

Sir 

they link with linker clients and others, and this is healthy. We 
feel the REs should work to mqlfntain the dialog character of linkages 
at the individual level and a|t impersonal levels, too. There are no 
clear answers, however, to^ problem of how to build into phased im- 
personal activities the participative, self-correcting, and reciprocal 
characteristics ofjijWierpefsonal linkage. 

* Procedures need to be developed for linkages in the following areas: 
•« (I) for need-sensing at all levels; (2) between RDx and top-level policy 
making clients;, and (3) with the R&D producing community. The NIE sol- 
icitation indicates that each of these linkages will be forme^d, Mit we 
have seen little elaboration of how. * 

t 
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The Content Level • 

Ve have said many times that the q^s^lity .and perceived utility of 
existing R&D-based inform?ti1)a may be « batlrier, even given efforts 
to screen for quality, package priority areas, etc. This is more of a 

problaa at the national than at the RE/regidnal 'level, since the latter ' 

L, . - * 

will contain aore practitioner-initiated Inf onftation, and since the 

e * 

closer source is likely to be perceived as more relevant in any case. 
Relationships Anong; Predictiv e Factors " , ■ . 

The predictive model asks us to^ evaluate background forces from 
the standpoint of how they interrelate to produce effects. At this 
point the best guidance we< can provide i^ a set of questions which need 
to be 'asked about each oredictor: 

does it affecP^tKe whole RDx effort equally? 

i (2) if not, does it appJLy to only one or a few of the linked^ 
elenents in RDxl or does it work in different ways for the 
different groups ot people involved? ^ 

•*t ft ' ' 

(3) if not, is this a dimension qn which linkage partners 

should be as alike as possible? ^ • ^ ^ 

(4) if not. does this predictor require different-yet-compatible 
conditions, actions, ot opinions; or, are there different 
predictors which must be compatible? ^ * 

(5) if not, is this a content or. linkage-procedure factor? J 

^ (6) if not, then we probably don't know enough about this pre- 

dictor and need to discuss and research^lt. 

: 

OUR 'Fir WITH THE OTHER KDx AUTHORS 

Most of the ixportant areas of agreement or disagreement with th^ other 
,RDy authors fit within the predictive model headings, with additions dealing 
s with issues such as need-sensing. We will cover the more important areas 
beJLow. * ^ 
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There is not too much to be said at the societal level, perhaps 

t 

since all of the papers, including this one, are suspicious about ranking 
sweeping corjnents on the grand scale. Mojkowski's (19^7) points relat- 
ing to the conf igurational approach, which interrelate factors somewhere. 

above .th.e interotganizational , parallel our feelings nicely, 

• ^ 

Most of the action starts at the organizational and interorganizat- 
ional level. Beginning at the start with the issue of planning, we are 
in agreement with those authors (e,g.. Gross,- 1977; ^Iqjkovski, 1977; 
Zaltraan and Sikorski, 1977) who recommend raore.careftfl qr better plan- 
ning activities. We would emphasize, hoWever, the necessity for'^ par - 
ticit)ative planning, involving clients from the beginning, ;Since the 
beginning is past, we echo Mojkowski's concern with what RDx must do ta 
overcome barriers which have gro\/n as a result of RDx's ^tgof-centralized 
and too-rexclusive planning approach iru the past. 

Mojkpwski ties perceived benefit into the process of clarifying 
goals. We have motioned ,the benefit issue .several times-, and it is 
linked to need structures, percreptians of the wortrf oi -'Ril^, and so/op. 
Groses' (1977) cpmmeiits on perceived threat appng- organizations • ^ 

would note that RDx 



1. • w , .1;^' 
with whogpDx ^might *co^^ete is well taken; but we 



cannot be blag^d^f or excessive 'levels of oTg^Jjizat ional paranoic it may 
encounter elsewh^e're^ ^Sti^l^ this again ties into the need for partict^*^ 



pative planning, and ^i^eh '^'e past. of the effort^ there raBy be a need 
for some f enceoinendi^. with ofeHer important groups* Overload is also 
an issue mentioned 'IJy naixjy authors hot)\ at the inter- and intra- organ- 
izational level. We have covdr^d this issue from several^ perspectives, 
and are in agreenrcnt witl^h'a^? the others have said. 
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Gtoss' coaments on leadership skills again r^ind us of modern 
organizational -theory, and there are close affinities between our view 
and those of the other authors who have a base in this field (e.g., 
Zaltzan and Sikorski). This bridges over into the individual level, 
of course, but we ng^de fewer marginal nc^^es relating to this in reading 
the other papers. Perhaps we are feeling some difficulty here since it 
la'difftTult to make too many comments at the individual level without 
personal knowledge or research data on all of th^ individuals involved 
in the RDx^ffort. » 

At the procedural level, we resonate to the st^ss on multiple 
channels mentioned by Mojkowski. His term "collabo;:ativ^ affiliation" 
i« a central concept in our conception of the linkage process. The 
•-educational r.atketing study (ERIC/TE, 1977) also Is useful as background 
information here, highlighting the importance of interpersonal, often 
intra-organizational information sources. 

Zaltaan and Sikorski parallel the points we made in Part 1 con- 
'- cerning content . "dealing with characteristics of innovations. In 

looking at innovation content, however, both Wfe and Mojkowski caution 
that coraunication is not the main reasoii for non-use, while lack of 
• perceived value of R&D and inability to implement are. The issue of 
hard vs. soft innovations also comes up, especially .in the Bean and 
Rogers (1977) paper, and the need to fit the conceptual approach to the 
field (which w'^s central to our discussion in Part I) is illustrated in 
their cautions about the fit of the agricultural extension model in 
, education. Time lags and momentum for change also tie into the hard- 

soft diaension, with education being in a position where softer inno- 
• ^ vations taHe longer and thus are. in more danger of losing momentum. 

ERJC . . 



Need-sens ing and .feed-forward functions (or their lack) are hit * B 

a. , /- . o 

hard by cany authors > though we are perhaps most insistent in this 
area, basei in our concern for balance and client-participation. Bean 
and Rogers Iv^hlight the im^rtance of early need-sensing, or rattier, 
input aitd con^irolVof farmers in° t^e early stages of the agricultural 
extensiotn systeci, rkls fits closely with the problem-solving and link-, 
age approaches. They note that RDx looks "top heavy" — another way to 
say this is that RDx is "bottom-light." Their phases start in the 
field, as would a 'need-based approach, and we feel they ar^correct in 
setting up phases in which institutionalization follows linkage build- 
ing and a consolidated.'^support base. Rich and Goldhar (1977) also^^i^- 
pose ^ri,dging users in early in specifying the value of information, ' 
goals, and priorities. V/e would agree if their definition of valuation 
also includes comparisons of the value of R&D information, other kinos 
of inf?)rmation^ and non-information solutions to problems* This is one 
expansicfn we would add to their first step 5f asking practitioners afiout 
information requested — we would start by asking about problems and 
successes, then filter "doxm to'types qf solutions^f or problems, the role 
of information as one kind of solution, and finallfy the importance of R&D 
as one kind of information. This approach provides wjiat w6 feel is a 
needed context around R&D solutions. ^ 

. Kotlcr, et al ; ^s views of need-driveti^marke^ing as exchange^ seems 
to miss an important point: what about the other side of exchange, i.e., 
what happens to producers and R&D itself as a result of exchange vith 
practitioners? There seems to be no place in their model for allowing 
practitioners access to R&D policy and goal-setting. ' Tieing evaluative 
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feedback into product re-design is not the same as giving clients the • 
ability to have a real influence on the bcoader issues of what policy, 
should^e, vhat R&D should do, and indeed, what the very interaction 
process should be \>y which they nake their inputs. We feel the market- 
ing approach needs an infusion of organizational concepts to be reallV 
fruitful, also* 

V.'e cculd go on with this synthesis, but we feel we have covered the 
major areas. From our perspective, howevef, there ieems to be an author 
or two <nlssing in the set of papers: there is nothing here written by^ 
a practitioner , be he/she lifitcr,. teacher, administrator, or whatever. 
Again, the very process RDx and all of us who have written these papers 
have taken is very "top-down." While many of us have tried ^o add the 
missing component, a^d serve as stand-ins for the ^practitioner perspect- 
ive (since our collective experiences appear to point very str9ngly in 
KPU as a dialog among equaf partners) , we ultimately cannot go very far 
with the process. In the final analysis, there are two kinds of linkages 
in PDx (or any KPU effort): those in or as a result of the effort, and 
^^^^ about the effort. If we stress reciprocal, dialog and exchange 
in the former, then it seems logical that we should do the same in the 
latter, 

RECO>!>{ENDATIONS * - • 

We have used- several different perspectives in >this paper, analyz- 

' r 

ing ROx from t.he .standpoint of operational modes, predictors of link- 
age, and a general concern for balance in both th'e. effort as a whole and 
in tte specific linkages whicK will t.ake place within it* We have seen 
that RDx may be too complicated to be summarized In^^y one theoretical 
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approach cr ooerational feod^ n eve rChc less', we have argued that the 

"linkase predictive" model can be us'ed to sua-.arize and i;itegrate nost " • • 

of rte -areas inioortant in-the design and f-unetioning^^ ROitr^ 

^ Our discussiOTi has ^produced 'several recurrent thc^s, nost of which 
are echUd ch^ other RDx '^uthors, whicl^ we will now cast in Ccrais of ^ 
recom^nendations ^O^r the effort. We need to caution^t these' recon.:nend- '0^ ^ 
ations are' not really the final word -- they just come at the end- We 
feel it is necessary to read at least the sections which follow dur , 
presentation of the oper»«*«ial m^es.^o.get the flavof and fetvor of ' . 

our concerns. Much of the analysis and many of ovlr recommendations ^Ijete 
niay be seen-as stressing balance in linkages, recipr octrf in effects • 
(i.e.. both on R&D and policy, and on practite), and openness, and pac- 
ticipation a raanagemexit and operational style for RDx.^ 

Below t,-e wiU propose three broad sets of recoTT.iaendatrjx)ns de- ,^ 
rived from the analyses above. The first pertains to the operating 
philosophy and image of RDx. The second relates to the operational modes 
y^Thich night>e emphasized. The^third^ rel^s to the process of system . 

monitoring and redesign. ^ 

.- ■ • <• 

A. Operating Philo sophy and linage. \ . . ^ 

A 1 We believe that RD^c^should strive Jor consen^W among ■"^"Jers " 

relevant stakeholders concerning its operational philosophy an-f; 
iJa.e We believe that that philosophy should place most emphasis 
on linkage, resource brokering and problem-solving assistance, ra-. 
. ?Ser than ^n research and development products^per se Component | • 

' ele=ents of t^hat operating philosophy might Include: ('^) -^^^f 

orientation, (b) responsiveness to clients. jj^^ "Je,,, - 

' " ceVn^-ng needs, solutions, and reactions to solutions, (d) the broker 
role (<*,n;ecting clients to 'a universe of resottTce persons, p^o- 
dSts and services)! (e) providing a range of alt ernatives which ^ . 
leave the client with meaningful choice an^ a sense of .con ro over , 
V the decision-mking process. X£) £ollow-Up capacity ^^/"'li""^ " ' . 
cUents that RDx is concerneVnot o^ly with dissemination but Mth 
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* the..f.Ull cycle of problem-solving and educational renewal, (g) cap- 
acity building ^o that clients can ultimately* take unto tl^emselves 
:the resource linking and problem-solving functions that RDx* init- 
^ ially provides. . ' , 

A. 2 RDx should work to build the strongest possible links .to other 
^ linkers, brokeifs and consulting services in the "natural network" 
to deconstrate its non-exclusive and 'complementary functions, as_^ 
Welles to enonaously expand its resource linking capacity. 

' , A. 3 RDx should strive in many ways to cultivate' and broadcast 
an iciage of client-centered resource linking, as suggested 
in recommendation A.^^. Image building activities j^ould serve to 
allay fears of ofher stakeholders, and to develofe-^' clie^* constit- 
uency which is aware of and interested in the t-j^S^^ of services 
• which" can be provided. 

B. V/hat. Operational Modes are Most Appropriate for RDx ? * 

We recommend that RDx planners ^nd decision-makers review the des- 
criptions d^the eight operational modes we have" presented, to determine 
which apply most strongly to the type of effort they are trying to develop.' 
In making this determination they should consider the fact that it is hot ^ 
possible to operate well in all modes simultaneously, given present and 
projected resource constraints of RDx. Furthermore, ' an attempt to invest 
in too many operational modes simultaneously may. confuse 6he image and the 
operating philosophy, bbth to your clients and to your members. Thirdly,* 
the adoptioh of somewhat contradictory modeas, for example "Knowledge-Based 
'Problem-Solving Consultation," and "k&D Broduct Dissemination^" may create 
role conflicts for persons and organizations within the RDx effort. 
Fourthly, members of RDx who are Labs and Centers have a history, capacity, 
and image connected with some of these modes, e»g» , R&D product dissemi- 
nation, but not with others; hence, if they extend too brolly they may 

> 

not be building on existing strengths, ^and may be acting counter to. ther* . 
expectations of important clients and stakeholders. 

We would furt^r make >a few suggestions concerning the specific rele- 
vance .of each of the eight modes as follows^ ( ,^ ' N 
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. 3.1 ^'urturing the Natural Network ; It is clearly beyond the cap'acity 
of ?w'M to follow this mode completely , in fact, RDx represents onl* 
a Dsir: of ,a federally-funded >effort to nurture dissemination capa- 
cities in existing institutions and to fill gaps between them.- An- 
other problem in pursuing this ,stvrategy is the likelihood that re- 
sults will have low visibility anM. e:;hibit little short- tern evidence 
of payoff. RDk needs such evidence to survive through its formative 
pericd. RDx should .not assume that there are effective linkages among 
the many ,dif ferenC natural networks which exist, however. Indeed, 
the creation of these should^ be the prime goal of RDx in this mode. 

B.2 Continuous Flow Dissemination : RDx will require some activities^ 
in this mode to build a constituency and to build an awareness of and 
interest in its general objectives, and its values to that constitu- 
ency. K5>^v5^ it seems unlikely chat this will be a prime mode for 
RDx. 

senination : It should be noted that planned pro- 




atio^ isf necessary to get the widest and fullest utili- 
tiona)lTl&D. It should a^-so be noted tha-t R&D Centers 



actiVe .disseminata 
zation of educat 

and Regional Laboratories have traditionally and semp tir.es voxy ef- 
fectively engaged in- marketing t^eir own products. therefore recom- 
mend that .RDx give further consideratiion to the pl^ce of and nded for 
this^ mode witti^n a total system configuration. In particular, they 
should consyier how new RDx initiativ^es in other modes wi*ll relate to 
or coiTf lict AKh past and ongoing Lab and Center activities, which are 
clearly, in Wis mode. For example, one might ask how "alternatives" 
can be posed fairly and effectively by an agent who has devoted one 
third or more of his or her professional life to the development of 
J only one of those alternatives. 

> 

B.4 Instant 'Response R&D ;' The' major concern here is duplication of 
existing effort. There has been more progress in the J^ast decade in 
this larca than in any other in Information services, and several non- 
nefibers" of, RDx are proven^and expert providgrrs (e.g., SMERC, RISE, 
Kew Haven ERC, etc.).' * 

B.5 Rapid Response Reporting : RDx needs to exper.iment with this 
promising strategy ,\ but to be fully aware of its cost implicati9ns 
and the necessity of being e>c,tfeihely selective and strategic in the 
\^ questions ^nd clients it wishes to cover in this way. Af ter 'a "free" 
start-up period during which the service presumedly proves its value, 
a gradually escalating f ee-f or-service schedule might be implemented. 
Rapid reports should also feed into continuous flow channel^ as a 
secondary' market, to multiply the number of users who might benefit 
and to it^.prove the benefit/cost ratio. 

B.6 Coordinated, Mission-Oritented R&D : This mode is clearly out- 
si<i^ the cost 'feasibility realm of RDx as currently conceived; how- 
ever, through the feedforward function RDx should play a key role 
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• in a larger problemrsolving loop. which involves NIE, universities, 
private organizations, states and labs and centers. FeedforwaW 
should serve to articulate real and pressing client. needs and con- 

♦cer-s, and should activate the organizations responsible for knowl- 
edge building activities. The fact that RDx does this (with cred- 
' ibie exaaplesO should be broadcasC to its constituencies so that they 
can ur.dejrstaad and Appreciate the purpose and value of the feedfor- 
ward function. 

B.7 "oc User Research Services: Many pfeople and org^anizations 
in the "natural networks" have the capability of performing such ser- 
'. vices " and many routinely do so already. Therefore, we would urge 
RDx net to e-otnpste in this area, but rather, to serve as^^^roker, 
especially, to connect clients^o unusual or remote helpers. 

♦ 

• B>8 Knovledge-Based Problem-Solving Consultation ; Although it is 
clear from much of the early discussion among RDx members that this 
is the preferred mode, RDx should be cautioned to consider the very 
high costs of providing satisfactory and, rewarding services of this 
nature. RDx must be very selective, and perform very well, so that 
it may serve as a model for future educational cooperative extension 
and problem-splving programs funded by federal and state initiative- 
Again, RDx should Operate ^s a broker for outside resources who can , 
operate in this mode. 

Monitor iu2 and Continuous R edesign of the RDx Effort , ^ 

The KPU linkage-predictive model proposed here represents a reason- 
ably comprehensive and systematic approach to defining and modeling 
the functions and predict^rs ot an effort such as RDx. We propose that 
some such model be adopted or adapted by RDx to understand, monitor, and 
evaluate itself. We furtheiL^pr^osfe that such modeling efforts 
and data collections be used in guiding the continual redesig^and self- 
inproven:ent of the effort and its many elements. This means beginning 
with a conceptual approach which is shared by RDx and it§ clients, then 
basing evaluation and change on that shared ^understanding. 
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APPENDIX A 

A STRUCTURAL EQUATIONS APPROACH TO THE ' ^ 

KPU LINKAGE-PREDICTIVE MODEL 

, It is insufficient simply to say that some broad classes of predictors 

relate to KPU criteria. Pred^^ctive models cannot deal with this level of 
uncertainty — some structure, restrictions and assumptions must be made. • 
The issue is that of getting a model specified t*o the point, at which it 
,may be analyzed. In this section we will begih this process for the "new" 
K^^U linkage-predicpive model we introduced in the body of this paper. In 
beginning, we wi^-l be c/)ncerned with, developing the model to the poi nt B ^t 
which it: (1) lallow^ for multiple "criteria" of linkage, dissemin^trlonV 
and utilization; J (2) includes time as a dimension to attempt to ^et at the 
dynamic charajster of linkages; and (3)^ handles the various types of pre- 
'dictors and predictor interrelations mentioned in the text. We Wed to 
elaborate each ot these points before discussing the model itselfi'^ ^ 

Criteria ; One danger to be avoided in model buil'ding, particula^r^y in 
' t;he area of KPU, is that of choos'ing "criteria of convenience": tho/ 

things we can measure most easily, regardless of their importance. / I^or 
' example, it is. easiest to measure dissemination or tSransmission acciMities 
such as whether some knowledge or innovation is or, Is not delivered, /or 
whether specific clients' needs have come to the attention of others/. It 
is much more difficult to determine actual use or impact of either i'pno- 
vations or needs, since (a) effects take^ time to occur; (b) they are likely 
to be diffuse and integrated into the ongoing operation of organizations} 
and (c) the causal effects of innovation or need messages are difficult 
to extract from effects which occur for other reasons. In this model^^ 
then, we need to insure that criteria are not chosen because of their method- 
ological simplicity rather than because of their theoretical or practical 
importance. * ' 

The ultimate criteria for linkage are hinted at in the definition we 
provide'd in the body of the paper*; potential need reduction through^ 
delivered innovation, knowledge, or need statements, and mutual under- 
standing between the linkage participants. "Potential" is an important 
term here: we must be able to separate what takes place in a linkage from 
the context-affected outcomes of that linkage. Thus, the interchange of 
needs and solutions which takes place In a linkage may be seen as a neces- 
sary condition for change in either the client or the solution-provider, 
biit the interchange is not i4entical with this change. Linkage ,is, at its 
most elemental level, simply a type of interpersonal or intergroup communi- 
cation jpfocess, with communication defined also very elementally as the 
sbi^rjnj of meaning. Effects of> linkage begin to take place among the 
linkage partners while the communication and sharing is going on. The 
ultimate effects may^occur a long time after, once the participants return 
to their organizations, and plan and carry out activities which affect 
behaviors of others into the future. 
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Linkage effects nay be informational, attitudinal or behavioral, 
though we tend to support the view that the only effects which ultimately 
natter are the behavioral changes — what actually happens to and as a . 
Result of hunian behavior in the realm of (in this case) improved educational 
D^act^ca . Practice implies behavior. Thus, the interests of the model 
should parallel those of the policy-maker and the practitioner; extending . 
outward to the final changes in practice , produced by linkages. Tnis does 
net '-O'V however, that the intermediate criteria are unimportant. 

There is a more immediate criterion to be included, howevei;, and that is 
the io'nnation of linkage themselves. The model must be able to handle 
bo^h those fa/nTrs--which lead to or control the probability that linkages . . 
will .occur, fid (once formed) the chain of effects of the linkage. 

Time: The chain described above, in which linkages form, endure, 
and eventually h^ve effects implies that the model must be. able to deal 
effectively with the time dimension. That, is, the nodel must be dynamic. 
F igure A-lJ >hows the si'mplified time order in' which linkages form (Tl), endure 
(12), are^carried back to the parent organizations (T3), and have effects (T4) 

• , (Insert Figure A-I about here] 

'At Tl we may think of tKose factors affecting the compatibility of the 
two systems or organizations as the shorthand term for the general factor 
which determinesj^hether a linkage is likely to form. Perceived benefit* 
is another ir.po/tant component. Given some minimal level of compatibility 
and perceived benefit,' the systems send corponeats ' (ysu^Uy persons) to 
be'involved in the linkage lasting throughout J2 . Here those factors 
predicting the participants' linkage abilities become imp.ort^nt, ^as do 
ttxe procedural and content factors within the linkage itself. At T3 • 
the participants return to their respective systems, attempting to trans- 
form and r^-transnit what has been learned in 'the .linkage, or to affect 
some change in what that system does or how (at TA). Here organizational 
predictive factors become important, in addition to the system-manipulation 
skilJLs of the 'former participants. 

.The .dynamic character of individuals and orgai^izations becomes import- 
ant, since it is clear that the situation is not s tatic,^ while^^the linkage , 
is taking place*. Organizations may not b4 at the same "place" at T3 as 
they,were at Tl^ ^v^rhaps stranding the linkage participants. The linkage 
paiilcipatits maMheraselves be changed so greaUy. that they lose their 
a^lities to fAinction within their organizations^^(e. g. , cooptation of 
practitioners, or resource persons "going native"). 

Predictor Levels : The predictor levels follow roughly from the di^^ 
cussion above, and these have been discussed in some detail In^the^d'y 
of our- paper. Here we will only elaborate on the methodology used to 
develop the predictors. 

Ve combined several sources in this process. We began with the classes 
of factors which pronote linkage or utilization, such as those from Have- 
loc> (1969), Havelock and Lingwood (1973), etc., and the conceptual scheme 
of Giiba and Clark (1974). We checked these by coding factors found to 
promote or inhibit dissemination and utilization, as presented in the 
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abstracts contained ift the 1971 NIMH"^ review of principles of research 
utilisation. 

The Statistical Model 

The' statistical level of our approach runs far ahead of the current 
conceptual level of our model. This Is unavoidable, as the appro'ach used 
.here is the best one available to handle the problems of multiple ctitetia^ 
time orders, and complex interrelations of predictors. We will consider 
linkages, riot individuals or jgroiips'; to be the units of analysis in our 
model. We will also 'have to make" some rather grandiose simplifying assuop- 
tions' about definitions, measurements jT scalar , properties , and indeed, about 
the very measur ability t)f the key concepts. We f^el' it is better to think 
big and* to make these assumptions while ignoring many of the limitations 
on the model; the alternative is to neglect the task of beginning to formu- 
late- a more comprehensive model of KPU. 
» 

' The statistical model we w^l adopt here is that of linear structural 
equations. These equations may be seen roughly as a much move powerful 
form of path analysis. The technique, allows: (1) multiple ol>served indi- 
cators which are accounted for by underlying "true" vxonceptjs; (?) reci.pro- 
cal pxedictive linkages between criterion (endogenous) concepts; and (3) 
correlated error tevms^^ desired. The method is covered by Goldberger 
(1972), Goldberger and Duncan, (1973), and Joreskog and van Jhillo (1972). 
We will not discuss the "method in'any detail here, since at this formative 
level we will be using the logic of structural equations almost at«^^vgym- 
bolic or anological level. The approach makes us pay attention to details 
and interrelationaliips even without* a detailed knowledge of the method; 
and that is what is important at this stage. 

0 

The basic model with which we start is giveti in Figure A-2 . Here we 
see souJTCe and receiver systems or organizations (referred to *in capital 
»letters)f and individuals (in lower case)' who emerge from these organi- 
zations at Time 1 to enter into a linkage enduring through Time 2« Effects 
of the linkage occur in both organizations, as a result of ttfe acts of 
the' participants during Time 3, resulting in some utilization acts or 
changes in the organizations at Time 4. These circles do not represent 
the organizations or persons in the dj^scriptive sense normally used in KPU 
descriptive modelling; cather, each circle is a criterion ^concept meas- 
ured by one or more observed indicators. At Time 1 the organizational and 
individual circles stand for the broad concept of linkage-readiness ^ and 
afterward t;hey may be seen roughly as linkage impact . The exact defini- 
tions^ depend on what measures are used to represent each concept, much as " 
one would label a factor in a factor analysis according to loadings on the 
observed measures. Note that there are two predictive arrows between the 
organizations and individuals in %aeh time period. These account for behav 
iors and attitudes which are formed in reaction to (or by perception of) 
the "other." 

[Insert Figure A-2 about here] 

There are five ways o-r "classes" in which predictors operate ^n this 
model. Not shown in the Figure is the fact that each class may be made up 
of several separate but interrelated predictor concepts, and that each of 
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these is a construct measured by one or more observed variables. Further, 
these predictors (exogenous concepts) may change firom Time one to Time 3, 
so there will be two sets of measurements for each\construct. 

The five classes or styles of predictor operations are: 

A. Forces which affect both source and receiver organizations or indi-^ 
vidual^ in an equal manner —.e.g., social climate for change, laws and 
regulations, etc. These may be different at the o4;ganizational and 
individijal level, .so we have , both upper and lower case versions ("A" 
aijd "a" predictors). ^ ^ . , 

' B. Forces which affect either source or receiver organizations or indi- 
viduals/ Some elements, e.-g., organizational size, would be included 
as separate predictors applied to their appropriate organization. 

C. These predictors are "homophily measures; instances where the 
absolute level of the predictor is not important, but similarity be- 
tween the two organizations or partners\is. Appearance, background, 
etc. on th^ individual level would fit here, as might organiz ation al 
type and so on." Measures at this level would take the form of ditfer- 
ence scores or ratios between S_ and R, or between £ and j;. 

D. Th^se predictors are interactions or pattern variables in the v 

. ^ limitations imposed by t;he linear mpdej. used here. Examples might be \^ 
S's desire to provide help coupled with R'.s desire to receive it; or ^ 
3's transmission skills coupled with r's listening skills, etc. 

Ei These are elements which- affect the linkage situation itself; 

primarily the procedural and content factors elaborated in> the body 
of the paper. One must be careful here, however, to distinguish be- 
tween those factors which predict the situation from thosfe which stand 
for the criterion of linka^ge itself; the latter would probably be meas- 
ures of anount of informatioa (needs and^olutions) transferred. 

We will not explore here the relation between these predict:or "opBt-^j / 
ating styles" and the levels of pre'dictors discussed in the paper. It 
is obviously possible to enter .styles and levels as margins of a matrlxT^ ' 
and to enter predictors according to where they fit according to what we 
k-now about KPU processes. We would probably find that more abstract 
levels (e.g., the societal) have predictors which tend to operate in style 
A, and that as the levels become more specific and ^Individual, the 
operating style moves down toward homophily and compatibility. This-*i^ 
only a guess, however, and we leave this exploration for a later time. 

Ignoring the f^ct that there are likely^o be several^ concepts in 
each class, we can express the model In terms of a set of equations, one 
for each criterion concept, as in Figure A-3 . The. matrix of "Betas", 
with each row rep.resenting one criterion, shows that there are hypothe- 
sized relations among the criteria, relations whose sign and strength the 
empirical analyses would determine. The matrix of "Gammas" shows how. 
each of the predictor concep'ts (the columns) is hypothesized to relate 

« (Insert Figtire A-3 about here] 

■ .. : 157 . ' 




to each criterion (row). The four time periods are also included in both 
matrices. In addition, "time zero" is included to handle the effects of 
past utilization experiences on each system and pereoA^, e.g.,, the momen- ^ 
tu© generated by past success, or the resistance from past failure. 

Let's look at the^model elements before the linkage takes ^place, at 
Tir.e 1 (the first four rows in both matrices)* The first f our 'criteria 
here are configured to mean linkage-readiness, and could be measured by 
attitudir.al or projective behavior measures at the four levels (S,R,s,r), 
or by ccnu2it3;ent of effort to impending linkage. Need is a major compon- 
ent in R^s readiness, and having solution materials available is central 
to readiness In S. The Beta elements indicate that each organization's 
and person's readiness is coq^itioned by perceptions of the other organ- 
ization or person — bringing in the key interpersonal perception elements 
of the linkage concept — ^ and each person's readiness is predicted by the 
readiness of his or her organization. The matrix of predictor paramenters 
on the right. (Gaimnas) shows that past utilization in both organizations 
predicts readiness in both,* as do the predictor concept sets A through D. 
similar predictive relations exist for the individuals. Note that coef- 
ficients for A, B, and C (and a, b, and c) elements are constrained to be 
equal within each set (i.e., the subscripts are identical), type B pre- 
dictors are different for S and and s and r, since these forces are 
hypothesized to operate differe^ntly in each organization or on each per- 
son.. X 

The extent or intensity of ^iAlkage is predicted -by all four readiness 
criteria (row 5), plus the external linkage predictors (E) as discussed 
aftove. The Time 2 period is variable, of course, ranging from a single^^eJr- 
counter to a protracted interaction, and duration* itself is one of the proe- 
'dictor. concepts -in set E. The methodological issue 'here is how to divide 
up the time periods for analysis uprposes"; but w'e won't even attempt to 
solve this thorny issue here. 

At Tine 3 we encounter the first effedts'of the linkage, on both p^ti-* 
cipants and their organizations (rows 6-9). Effects could be measured by 
dissemination measures, and ^ain, by personal, and group Reactions. The ^ 
Beta predictor patflern is similar to that of Time 1, but with one addition: 
readiness at Time IJ predicts effects at Time 3 for both organizations and 
both particip^ants. 7 Also, the predictor concept matrix ,df gammas is equiva- 
lent to ttfat *at T^Ae 1, with the sa^me coef 'f icient-emiiXralence constraints 
imposed. ^ ' ^ 

Finally, there is utilization* in both organizations: for R this would 
be change in the form of implementation of "Bolutipns" brought through the 
linkage; for utilization would be integration of R's needs into planning, ^ 
programs,. or products. In the next cycle of analysis, of course, these 
utilization constructs wQuld become the first tvw external predictors in 
the matrix of Gammas. - . ^ ^ 

Summary 

We have blithely ignored the complexity of ^ structural equations models, 
eXact definition of indicators of each construct (which are npt even shown 



158 



\ 



78 



in-FiuresA-i'and A-3), and problems of iheasureraent, to say nothing of 
feasibility of ^^lecting , enough data to be able to do an analysis. 
We do not intend that this model be tested in its present f°rm* For ex- 
ample, each of the criteria and predictors in th-ev model is. likely, to be 
expanded into several concepts in applicati(»i. 

Our purpose here was not to work out such details. 
■but rather, to show one way in which many eiemeilts. interacting in complex 
waJs oJer ime. coulTbe presented in a form vhich allows us to U see 
our asl-ot^on^ on paper, and (b) include some of the dynamics of linkage. 
?Ms pr^skatacion also i;dicates what our linkage-predictive approach can 
be Lvedbeyond the level of a diagram used only to describe what happens , 
In Te in^tan"e of linkage, and .toward an analysis of what ^appens in many ♦ 
linkases with varying levels of effectiveness. The trick, then, is. to ^ 
ian f opfrlaonsi; bihaviors and attitudes to maximize fh°se in -tors \ 
which best predict the criteria of readiness, linkage, first effects 
of dissemination, and utilization. The ability to guide chang^ is the 
final test of this or any other model. 
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FIGURE A-1 * ^ 

PREDICTORS AMD PROCESSES OF LINKAGES OVER t|mE 
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FIGURE A-3 Structura.l Equations Mod\l of ifPU Linkage 
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0 ^f^' 



OVERVIEW ^ 



.The task of iesigning t^e arrangements, processes, and strategies of 
a major organizational "mechanism such as the RDx is a complex and 
challenging assignment. Making operational and modifying drawing board 
specifications so that they are congruent with and will faVu^itate the 
achievement of organizational functions and specific objectives generally 
are even more ^con[ip lex and challenging activities. 

The designers of. new organizations tjfpically give primacy to their 
internal Qperations and problems on JiowsJthey bear on the achievement 
of their goals. Designers generally devote*' less time and effort to 
consideration of the external affairs of the organization and to the 
types of intj^^rorganizational arrangement^ and strategies that will 
. facilitate the accomplishment of organizational goals and the reduction 
of externally rooted impediments to their achievement. 



In the case of the Regional Exchanges, we believe that their inter- 
organizational relationships need to be plafed on penter stage for 
several reasons: first, the accomplishment of tlieir missions will require 
them to develop productive working relatfionships with other organizations; 
second, the performance of members of the dissemination networks in* 
which they vill be involved will influence materially their own per-y 
fornance; and third, the* success or failure of the Regional Exchanges 
will be a function of the behaviors of metfibers of their organizational 
role set. - . - 
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This paper focuses on the interorganizatlonal relations of Regional 
Exchanges i«.th special reference to a set of important problems that 
we believe deserve priority consideration in designing them and in 
attempting to itr.plement their programmatic efforts. ^ The specific 
objectives of the paper are as follows: 

1) to alert officials who 'design the Regional Exchanges and 
I those who will be responsible for their operation of a 
nunib^r of serious impediments that have arisen when 
largely autonomous organizations have been involved in 
collaborative activities and that have served as barriers 
to developi-ng productive and harmonious interorganizational 
p^lationships ♦ . * ' ' ^ 

"2) to examine the implicaticxis of these potential obstacles 
to productive interorganizational relationships for the 
iiesign and operation of the Regional Exchanged 

3} ^ to propose* strategies and tactics that may 'serve "to 

minimize their occurrence or dysfunctional consequences 

f 

'Because we cannot deal with the entire RDx, and because we wish to 
provide specific, useful information, we focus our attention 'on fche ^ 
most important organizational entities involved in the RDx - the 
Regional Exchanges. To dc^ a similar analysis' for the entire RDx is 
teyond the present scope of effo^^t. Furthermore, in our judgment, 
mxi^ of the propositions and the implications we-^draw from them for 
the Rxs are Relevant to other components of the RDx, 

At present the Rxs are dealing primarily with SEAs. For this reason, 
we focus our atfention on these two organization types although we. 
realize that the Rxs wish to reach out lateir to ISAs and lar^e city 
school districts.' Should such expansion talce. place we believe, our 
propositions and proposals will remain applicable. 



II 

Pri^TTo^cOTisidering interorganizational problems and their relevance 
for Rxs, it is pertinent to discuss several background and related 
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iss]Be3. These issues relate to two broad contexts: " first, the role 
of - the Rxs (and the RD:<-itsel,f ) in the Knowledge Production and^ 
Utilisation (fcPU) System; and second, the Rx as a part of an inter- 
org2r.i2£iional set, "K. 

Kno^lecse produccicn end utilization has as functions the development 
and u&e':f r.sv kr.ovladge^ During the pafet few years,- the dissemination , 
function cf '."JrV has been given an increasing, amount of attention at all 
levels and pcsrri^ularly in the Education-Division, 

' 

A, corollary issue to the increasing attention being given to dissemination 
is the notion of developing a nationwide dissemination system. The goal 
is to design and implement a system in which all relevant groups and 
organizations at all levels play a well-defined and appropriate role. 

, ' ■ . ■'• / ^ \ 

As a recent eniry into this complex configuration of organizations 
engaged in dissemination, - the RDx is attempting to define a. role for 
itself that will avoid conflict with existing organizations and^j^on- 
tribute to the development of a rfat^onwide dissemination effort, 

, The general problem to which the RDx is directed is the underuse or"" 
non-.use of P.ID outcop.es hy thpse^praptitioners at the sc;hool and school ^ 
district le-'cls. This situation is viewed as resulting ft^om a coliplex 
sei^ies of faczors. The major reason^given for such-'underutili^atiohhis 
the faaS^ co~.unication that exists between produce^ and consumers of 
R&D. 

Posing the problem in this way* moves the RDx to ''solve" it through 
new tacxics such as repackaging messages in different media or in 
creating new rrtessages or communication diannels betw^n researchers 
~^nd~de ve to pe r s -an d -p racti t ioner^ . — Wh i 1 e commun i ca t ions sy^eps need 
*^ itnprover.ent y • it is incorrect to assume that a fa.ilure to communicate 
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.or a l^ck' of awareness "is tlje major impediment t3 the o.ptimal us^ of' ^ 
R&D outcomes 'is schools. By fofcusing-on communications as the problem/' 
we are led awayf from 'analyzing other reasonable l^ypotheses for non-use. 

Reasons for non-use of R£.D outcomes are several Aid poor coptmunication 
channels ani techniques are only a portion of the problem^ RDx.m||iagers 
must recognize chat tliis is 30 4ind tjiat their ability to impact 'off" the V 
problem will be limited by the nature' and scope of liie. interventions 
they pr'Opc>s€. ^ 

That soipe fonn of nationwide dis^minaciorf system is possible or. 
reasonable is ^i^stioned by Cuba and Clark. Given the- large « number 
pf agencies and organizations, given the lack of consensus regvding., 
means and ends, and given the nature of the federal bureaucracy, they 
airgue th^t a true systeiri does not exist and may be impossible to 
crea^.— In contrast to the Cuba and Clark proposal, ue find tjh^t some ^ 
form of syste<i:izaj:ion is needed and is* possible ^9 develop. 

The role of the Rxs^^n JCPU is defined by th&ir position in the complex ^ 
set o*f organizations working in this area, tf the critical variabl^e 'is \ • 
implementation of R£cD but comes b^jRractitioners, the R^es will likely 
have'only an indirect and facilitating role in that outcome. 

The margiiiality oi the Rxs to outcomes, in the operating system is a ^ 
critical -vatiable. For one thing, the Rxs must, assume that Agents , • 

and "organizations' closer' tar the practitSloijer and responsible for' 
technical assistance in implementation are, in -fact, capable and willing , 
to take on that role using R&D outcortes/ The Rx^ must also assume that 
'the Of her agents are a^^en willi;*^ Co participate in the communications . 
^system being , developed for dl^&eminacidn and ' feed-forward regarding ^ 
R&D outTBomftS.- . I . 



The. Rxs exist within a configuration of orgaalfeations t\xat perform 
^iroi/lar or interrelated^ dissemination function^; Sever^al characteristics' 
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of the organizations (both individually and types) arje relevan^-^ 

. ^ V ^ * 

an understanding of interotganizfftional relations issuer. 

Each of rheVenber organiza^Ons' In the set has its. own internal. ^ 
organic aii^on problans. Also, ^ since 'each of the pajor organizations 
are developing nev or expanded roles in the, area 06 dissemination,, 
each cr*:£2izazion ter.ds to describe itiself in tetms of a potential 
=^t of capabilities and accomplishments. 



•or .expactr: 



/ * 



Our selection of the Rxs as» the center of attention ia based on , the 
fact that it 'is the 'focai organization in the set 'and can influence ^ 
most^directly the success or failure of the RDx. Given this position, 
the following relations are viewed as Important -to the 'realizat'ion of 
the- goats of the i6cs: - - * 



'1) establishing credibility^ and- trust 
2) ^^ozzra^icating openly an4 frequently 



0, 



bu£ldii>g>a' culture of collaboration 



It is 'important .to re<;ognize tha^ the organizations* in the set vary on 
a-number 0/ ir/ortan't Ifiipervsibns and that this variation can have major ^ 
consequencjes^ for 'the perceptions and relations » of the Rxs. Soqie of the 
more importan: dimensions ^long which members vary are: 

' ' 1') nu.-2beroand type o^funct;iops ' \ ^ - 

' 2) disseciination '^capabilities 

3> organizational' flexibility ' 

4)' disposition tdward^ innovation • ' 

5')r stability - instability^ 

y 6) leadership capabilities, staff experience pnd competencies 

^"^^i-/ 7) stage -and^rate^-ol' development ^ ^ ' , ' ^ 

8} . invoIvec^nt'\n-"the inper circle" 

9) relationships to school systiei^s/a ''reality'* orientation \ 

10) p^rcefcti^ons of' RDx • ] 

'* » » • • «» • 

' \ • ' . ^• 

Theretare many implications resulting from these background considerations 

for b^e interorg/nizatlonal problems which the Rx must address-. Rxs will ' 
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need ttf Cd^^imto accotmtJi'contfextual factors in developing relationship 
with other vgaaizations in the set. • General guidelines may be 'possibl 
develop and Afunctional servi^ig future modifications. It is not ^ 
Dossible, Kow^ver, to develop a set of rules for the futute development 
of thef s/stea. . ' ' • 



^Tl>ree br,oad secsjbf interorganization^l relations problems are apparent 
, 1) thos"6 dealing with roles and relationships; 2) those deal i'ng* with 
linkag^, particularly interorgani-zational ones; and 3) 'those dealing 
with ma'nag^a^nt^ of the focal organization - in this (;ase, the RDx^. The 
' sets<. are int^active, but^ are <Jiscrete enough to 9uppoi:t treating them 
separately. ' • . / . 

for each problen.set, a smalU dumber of propositions are pr^enrted. 
Tfiese propositiohs concern barriers that can inhibit the establishment 
or .maintenance of productive working relationships between two or more 
organizations engaged in a collaborative effort. 



> Propositions' Relating to Rolas and Relationships^ 



^ Proposition 1': When a New OrgJ^ization (NO) enters ^ territory to 
provide services sim'ftar' irr mature, to those x>ff ered by • 
Existing Organizations <EOa) ,^ there is a strong likelihood 
' that some members of the EOs wiLl" perceive the NO as a 

threat to their own personal well-being and- to the welfare 
'"^ of thej.r organizations, despite the><!iscl'aimers of the^ NO* • 



I 

Proposition 2: The greater the ambiguity or. vagueness -of the NOs 
functions and services as perceived by the EOs, the more 
likely the KOs will perce,ive the NO as- a threat. 
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proposition 3: A cbnaition Jhat has '.frequently constituted a serious 
iapaditsent to prograrps >d6velbped' ©r sponsored by a set of 
* • " or^a>.i2?tions is 1' the *ole oi^erload that develops for their 

*=ie=b4r3 as a consequence of decisions to embark on ' ^ 
' • ^^coll,2borative programs. \ 

Propa3iri.-r.'l: prsar.izatipnal representatives that take the tnitiativfe 
— - i.zr.r:zosi^i <jfc)operatiye or coUaborativfe ventures 'with other 
^. cr:i-.-:a--ions' freq^ent^TTy overstate what they oan accomplish, 
' .■ urc=r-3:ici3Ce the timp req,uired to achieve objeccives'or 

undefr-p^asize the .constraints to which" they will be expos&d. , 
They^lso often t:end""to be unreal is tic"' about the contriVutidAs^ 
their organization.,'wil.l bJ abl^ to make lo the proposed under- 
taking.^If the .venture is launched, it ddes not take long for 

• 'the part^|M{Cts"to^ realize that th^ have agreed to partici-. 

• ^te in^^laborative atftivibx^tl^ win draw upon their 
-^e = :-r:es b6C wiLl not achi-eveUts stated objectives. 

^Proocs'-tfions Relating to' Interorgani^zitipnal. Linkag^ . 



Proposi'tion 5: \ circumstance . t^at' frequently inhibit^ tl^ development 
•of -r::iuctive and harmoniotts relatiortships among organizations 
er.zBiiCin 'cooperative or collaborative ventures is the lack 
. - of'r;;;'anisr:s to facilitati open' and frank coninunicatibns in 

- th=ir relationships about substantive issues and, procedural. 



■ Pfopo'sitior. 6: The' absence of groundrule? in collaborative .v^Cures 
, . ■ ^ 6rganizati(As or lack of clarity about them if they ; 

*• exist] can serve//s a serious impediment to the' development, 
■%-'eifsctive intei;oreanizational relationships. ' ' . ' 



Propositions ^^^pfi^f^f^tp^ Management 

Proposicipn 7: Major contributing factors to the failure qf ventures 
'thvolving interorganiz^tional relationships "ar^ frequently 

^ 

their weak or inept management and the lack of leadership » 
exhibited by individuals whO) manage one or more of the^ 



parcicipatlng organizations. 



Proposition 8;.', A circumstance, implicit^in many of those earli'er ^ 
considered J that has been centraJLly involved in the wreckage 
/ ^ of interorganizational efforts, is poor planning, "Organizations 
invoIyed,in jp*ir^t end^avors--have generally dealt with their 
* . collaboracive activities in afT essentially ad hoc maime^, 

.' . ' ^ ■ " ■ V ' . 

PrOiposition 9: . In ''estatj^ishing new oi;^niz&tlons^'*considerable tiine 

* ' i\ . ^ » ^ ^ , < ^ » 

and effort* is lA^ually expended op designings their struc}fural . 

arrangements and" preparittg job descriptiopa^ Much less. 

' . ^ ' r ^ ' ^ . 

^ • attention' is devoted to 'engaging in a carefuj search for and \ 

selfrpting pers^onsiel who possess 'the capabilities required to* 

fill these positjLons; in a competent mannef. In cpn^equence, 
'« ►* 

* - ' ^ the rold performance of members of the new organization is ' 

^ often deficient in one .or more impoirtant respects when they 
se^^ve as. its orgariizattonaf representative. ^ 

"\JP4:oposition 10: "^Xiack of inonitorihg ^rvd fefidbacU* pro.cedures can serve 

t a ser-ioifs obstacle X;o, cqo^^jrafriye or cpjllaborative activities 

*^ ' * of ^ set of organizations. ^ • * * 

* ' ♦ \ . 

^ ^ \ "1^ . IV ^ ' ' ^ 

Althbugh the problenvs. ve» have identified frequently Aerve as barriers 



i^ ti^e. (ievp^opt^ent qf int^jrorganizational^jelationships, they're not 



.V • :.' 
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invariably,^ Thus, Jlx aanagers may be able to avoid or minimize some 
of these barriers. Following are sor^e observations on strategies* and 
tact^ics which would a^^pear 'to help reduce problems. 

Program^ric efforts designed to reduce orti^li'rainate obstacles to 
^ffecti"e i:::2rcrg£r-i2arional relationships' reqwre systematic and« 
continLir.r "1 cr.rin:: efforts/directed at the identification of^ serious 
impedimer.rs. z'raz ,are likely to occur during' ^iif ferent phafees of tke 
development i f ihe collaborat?ive venture. ^One strategy that may be 
highly' functional in* this respect is' for an RDx staff to developp ^ 
collectively ad obstacle . course -flow phart that specif ies 'the types 
of seftbus problems that will, probably artse at different iStages in 
its 'collaborative activities and^'a^tempts' to'fd^ntify their probable* 
causes. , . . 



'This type , of 'planning activity, especially if conducted on a continying 
aSasis, is functicvhal for several' reasons. ^ First;/ it identifies potential 
barriers. ''Second, it .focuses -attention on their probable causes.; Thi^rd, 
it leads to' deliberationV about coiiiTses of%ctfon that j^n be pursued to 

-prevent the Emergence of obstacles, fourth, it alert^s staff .members to 

^ ' ' ' ^ ^ - ( ^ 

thenwipact that the activities of the RDx and their perf6x:Tnance c^n have 



3n ^du^cin^ or enhanping the likelihood that potential^ 



obstacles will 



tui^n into serious orobLemsJ "Fifth, vieyijig potential' obstacles aloiffe 
> " * ' ' ' ' 1 « ^ 

a t^ime^^line can bring out 'in bold^ focfis the connections andnf'elation-' 

«hips azong potential barriers tcv productive interorganizatiprial ' ' ' 

relatiDiishlps. ' \ , , * •/ ^ " 

A^^ecoric^ observation has refeirence to , the impatJt that^the kinds o| 
.iifteractiops that* o'ccyr\in the ^ffltial phases o^ an Kdxs .Relationships 
with menjb^rs of .its origaniz^tional set' can* have oA^he number and' types 
of obstacles that wi/1 arise later oh, ' MaaaKspecif ically , if officials 
of an RDx do not or c«fino/t clearly Specify at the outset of their 



relationship wlch members of it^organizational set the^nctipns it 
proposes to perform, or if members of* the organizational s^t view theii^ 
,^rpsent2tion as fuzzy, these conditions will p^obab^ r:es^lt.,^nt .seriOus 
impedizra^rs zo their later collaboration^ effort's.* . . ^ ^ " , 

Our third observation about strategies and ^ourses of Action* that catv 

• be employed zo ainimize tfhe likelihood that serious interorganizational 
problems wiil arise concerns the priority that an RDx assigns to this 

^ function. If, we we have maintained, the development of effective 
wcj^rking relationships with members of its organizational set is a basic, 
prerequisite. for the success of ah RDx, then a top priority status needs 
to ^be* assigned t^J ^this function. In operational terms, this meens that 
the' primary duties of one or more staff members should focua on monitori 
*the relationships between che RDx and, members of it^ organizational set 
and alerting the organi^tion to actiial or potential Umpedlments to its 
existing or planned pvogrart^natic efforts, ^y^^ 

A fourth^ observation' pertains to the^utility of conceptual schemes or 
models for reducing impediments to cpllabor^at.ive efforts and to 
strengthen ir\terorganizational relati9nships. One type of model ^at 
cfould be^ heuristic for these purposes would be a formulation that 

• s'pecif ie^s the objectives* of ah RDx and tKen indicates* the stages through 

which if must move in it^'rel^tionships with members of its role set to 

^ ' . **' ^ * " • 

. achieve thecr.. 

^Ouj; fifth observation pejrtaiAs to^the importance of ,an RDx re<yDgnizing . ' 
that the so'urcfe of certain* impediments to ef fective .RDx-oifganizatlrbnal 
set relationshii)S may be needless conj^traints and. outmoded rejgulations . 
of external agencies in Washington^ D.C. and in their region* An 
analysis of actual aj\d potential interorganizatit>nal barriers from this 
perspective can result in efforts to remove these^ external conditions* 
If successful, they can result 4in the" reduction ^ impediments to 
prpductive interorganizational relationships* ' 
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lOTERORGANIZATIONAL RELATIONS- PROBI^S IN 
THE DESIGN AND IMPLEMENTATION OF THE 
RESEARCH AKD DEVELOPMENT EXCHANGE 

" ' ' 

INTRODUCTION 



Designing the arrangements, processes, strategies for a majqr n6w 
organizational' innovation such as an RDx is a complex and challenging 
assignment.^' Implementing them in vays that .will ma^dmize their contri- 
bution to the aqhievemrtit of organizational objectives is an even more 

^ •> / ' / . ' 

complex and challenging ^task. 

Designers of new organizations typically give priifiacy to tl|eir internal 
operations^ and problems. ^ They fdcua their efforts on developing the 
division of labor, authority structure, dnd, system of roles and role 
relationships that tl^ey- Believe w^ll provide, the quantity and quality 
of oitputs'^desired of the organization, whether rthey be products or • 
^ervicea. ' They ge^ierally devote less tim^ .and effort to'^helr external 
a^airs. They seldom examine the types of ioterorganizational arrange- 
ments and strategies that will facilitate the apcomplishment of organi- 
zational objectives" or tSat^wlll minimize externally based impedimen|p*s 
to their achievetaent . Their^^deemphasis of interdrkanlzational relations 
is undoubtedly a function of many condi.tipnsf including pressures to 
focus on internal operations and problems, uncertainties about the 
external environment, anH lack of awareness *of its importance f or ^. ^ . 
organizational functionipg. . ^ - . 

In designing Regional Exchanges (Rxs]^ however, it is essential^ f6^ 
several reasons that their interorgahizational relationships be placed 

^ . ■ ■ 



on canter stage f rom t^e outset. First\ if t"h^ are to accomplish 
their niis3tous they will need to develop^ and maintain productive ' 
vorjcing relationships with a number of other organizations. Second, 
4he attitudes and performance of members of the dissemination networks 
In T^ichn:hey will be involved casrbe anticipated, to influence; materially 
the perforaance of an Rx. Third, the success or failure of a Regional * 
Exchange will be largely a function of" its skill in coping with problems 
that arise! in worljing with members of its organizational set. ^ 

This chapter eS^nes the interorganlzational relations of Regional ^ 
Exchanges yith special reference to a selected set of .problems 'that 
we believe deserve priority consideration in designing them and in 
attempting to implement 'thej.r programmatic efforts. More specifically,', 
its <objecfives aye: ' » - * 

■ ■* ■ ■ . 

alert- officials x/ho design Regional Exchanges and those who 
• will be responsible for their *0]6eration to a nuniber of serious 

' / ^impediments: to productive and harmonious interoiganizatioxxal 

.relationships ^Jiat have arisen when largely autonoi&^s organi- 
zations have been involved .in collaborative activitie^ 

v ' . •■ ■ ♦ . ■ -'' 

2)^ to examine the ^implications of fehes^ potential .J)b8ta'cle8 for . 
the Resign* and operation of Regional Exchange^ /' 

'^S) to p;^opo6e strategies and tactics' designed to minimize or^ 
^ ^ prev^t their occurrence or dysfunctional consciences * 

^ . Our analysis focuses on the external relations of organizational units 
that are X5f strategic importance for the successful operation df the * ^ 
, RDx - the Regional Exchanged.'* Many of the propositiofts to be presented 
/ arid- the implica^ons for Rx's that we shall drawVerom them, however, may 
^ .^also^ave Relevance for the design and operation \l other <;omponents \ 

olf the Ri^x, * ' _ ^\ ' f " 
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The Rx's at present deal pritnarily with SEA's., However, it^is oirr , ]^ 
understanding that they later plan to work with other organizations 
such &s ISA's and large city school districts. We; therefore have viewed 
the interorganizational relationships of an Rx as 'including .agencies' 
It presently relates to and those with which it may^ becojae^nvClved / 
in the future. ^ • - ' 



r 
II 



BAQCGROUND CONSIDERATIONS 

To set the stage for our examination of b^rri^irs- to productive inter- 
organizational relationships and their ^implications or .RX's, we condide 
Initially, two contkxtual issues: firs^| the role of the Rx's and the 
RDx in the Knowledge Production and Utilization Systeto; — and^^cond, 
the interorganizational network pr set in which Rx's aife involved. 

\ ' ' / ■ ' ^ 

The Kncwledge^roduction and Utilization System 

Knowledge produitrieo-^d utilization (KPU) in education has been d^firv^ 
by Cuba and' Clark as- "indenting, engineering, and testing solutions td 
operating problems in schd^ls; disseminating knowledge throughout the * 
cbmmunfty; azd adapting, adop^ing^ >nd 'institutionalizing solutions £p 
Operating prcblans in e^d^ational unit^" (Cuba- and Clark, 1975). \ 

During the past few years, the dissemination aspect of KPU has received 
. inQreasir.g attention in.^ducatidhal circles., Earlier, it received 
JLess federal* attention than the research and development components of 
KPU. Sieber^975) views these shifts in emphasifi_^s detrimental to . 
the'frreatior.^^of a high quality RD&D system since he Views balance as 
one of its essential retjuirements. Sieber's observations remind us^ 
.that they are attempting to improve their capacities to become 
^ more effective disseminato\;s, and that their efforts are supported In 
large pa?%yby federal funds. Efforts to develop a nationwide dissendna- 
tion sptem also reflect the increasing considei^ation being given to 
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dissenination. As in the case'^of R&D, the thrust has been directed 
to the creatdfcn of a *'unif ied-syst;ems vi^w" of dissemination (Cuba 
-and Clark, 1975). The Reports Qf\he interstate Project on Dissemina- 
tion (19/6) anc'.thev Dissenination Analysis - Group (DAG) (1977) and 
the R?? ?re;?arsd for the RBx (1977) all stress the need for a nationwide 
disseniiacicn syst^i an<f the importance of desi:gning and implementing 
one in which relevaarit groups and organizations participate! 

As a recent entry into thiss complex configuration of organizations 
engaged^'iti dissenination, thfe Rxs have, attempted to define a constructive 
role f or ^themselves that avoids conflict with existifig organizations 
and contributes to the development of .a nationwide dissemination effort ♦ 

^ They have, been primatily concerned with how to increase the use of ^ 
R&D outcome^ by practitioners at the school ai^ schoAl district levels. 
The underuse .or non-use oi R&D-prod^cts is attributes by, fed^;EaLoiiiclal&, 
' to a- conpiBX and interrelated set of factors. They view the most 
important contrlbuCirig circurast^nce as. faulty communication between 
producers and epnsumers.^of R&D. Thi^point of view dominates the 
planning proposal for the Data Management contract (August f 1976). .It . 

, /. presents a de'tailed'.analysis of v/^aUaesses in present cojnmuni^dtion 

channels between producers and consume'rs and identifies their following 
defic.ienciesf 1) inadequate needs assessnient and market research ' 
studies; 2) narrowly-conceived evaluatio^' studies; 3) incomplete 
linkages; 4) consumer intormation not, reaching target audiences; 

' poor quality of consumer information; and, 6) inadequate information 
for building needed capacities. "These impediments are attributed 
primarily to faulty communications.^ It is^ expected that th^^Regional ^ 
Exchanges will""c5ttstitute mechanisms that will establish needed communi- - 
cation channels between producers and consumers and facilitate greats 
cd&nunicaticns between them. . * • : 

\Xlt^& R?? for the RDx planning contracts stressed the same type of 
obstacles. Of the four object ive6 it specified for the Exchanges,. 
t;hree ^ealf vil(h the need t(J improve cotmurii cations . The fourth 
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focused on "improving practitioners capabil'ity (sic) toNmake rational 
decisions to select and use high quality RdD and other, o^homes. " 
Although other barriers to optimal use of R&D outcon^s are lien tidned, 
it gives prinary attention to the need to solve conmunication diffi- 
culties. Since dis^eaination problems have been defined primarily 
as c^— ic£tion problefis, it is not surprising that the efforts 'of 
the RTt:* have zcccsbc cn developing new communication 'tactTds , for ' 
example, rsp^r.^agijig messages .in different media or on* creating new 
kinds of ressagss or communication .channels among researchers and - 
developers £n£ r^ractitioners. 



Few would questiT)^ the importance of Rx activities ' (feslgned to in^rove 
communication^^ However, it deserves emphasis thltj^the Assumptions 
that, communicatioa-obstacles and lack of awareness^f inuevatlorts are~ 
the major impediments fo* the ^ optimal- use of thfe outcomes of R&D in 
schools may be tenuous (Deats, 1974)1 .In addition, formulating the 
dissemination problem in this majjni^ j)»erlooks the possibility thaf 
a number of 'other circumstaniee m'ayfconstitute important determinants 
of non-use of R&D products. . * . v 

The explanation that identifies th.e key variables as deficiencies in- 
the communications system assumes that --educational products wi^l be 
ifsed and will solve school problems if educators are aware of them. ' 
Its^ssun?ticr.3 are similar to those positejd by 6uba (1968) ^about 
thA ltj.near connections among research, development, ^nd, "(dissemination. 

A basic prenise ':ander lying RDx activities is 'that lack of awareness 
of R&D products, has been the basic*cause of their noh~use.« Lack 
of utilisation, in turn, h^s been frequently cited as a primary reason 
for toe. lack of empirical data* to determine the value of R&D. However, 
another possible explanation emerges if we view lack^of ^awareness as 
a piece of important feedback: 'it may reflect the ineffectiveness of 
the^ overall. R&D strategy and the tactics th^t have been used in efforts 



. to create awareness. Other basic reasons for. non-use or-'under-use may 
be' that school personnel find little , of vaiue in^R^ products .or when 
they do," they are unable to implement then (Gross and Herriott , 1976) • 
In short, in acIdji/(^on to poor communication channels "and techniques, 
:,.|ayltiple factpi^s undoubtedly^ need to be invoked to account for non-use 

MP> dtstco^^^^ RDx managers need to r^ogi4ze the complex nature 
' of the disseiii^ation proljlems of their organisations. If they define 
* them unrealisticaliy, the scope and nature of their interventions^ll 
\e off-target (Thayer, 1973). 



f Cuba and Clark ,(i975> have que\ioned whether a nationwide dissemination 
system is possible or -meaningful. In view of the Urge nupber of 
agencies and organizations involved in dissemination, the lack of 
consensus •ab?>ut its objectives, disagreements abouf the most -effitacious 
' procedures to accomplish them, and persistent ^probJlems -of tli^ federal 
bureaucracy concerned with„dif f ^ion activities, 't"^ey argue jthat a 
system does not in fact currently exist and it may be impossible to 
' create one. They suggest, ,!0\at a "conf igurational" model, one that 
views edueat4:onal KPU ^ less coordinated ^d controlled than is ; ^ 
usually 'i^lied,, through the use of systems language, would be tnore 
' functional. In contrast, tq.the> views" of Cuba and eiark,^it, ia 6ur 
position -that greater systeniatization is n^^ed. We contend that the 
present state of affairs, is dysf unc^^nal and cliat. scarce resources , •• 
are not being uaed efficiently or efffectively. Instead o'f abandoning" 
efforts to establish a nationwide disserairiation system, we believe 
that It, is possible to design and iniplemen| .one thl^ ■can be highly 
functional. ! ' - ^ . 

The role of an^^c inl^^will be primarily MetetiivLnedJjy tOie functions 
it performs- fo:;.o?&aivLzations ifi its- area.' If ft defines its essfin^ial 
• purpose as' the facilitation of school district implementation of, R&D 
^ ^^oducts (Fullan and Wret, 1977), then an Rx could b|*fixpebted to * ^ 
serve 'as a catalys.t in efforts designed , to ;achieve that outcome. -/ 



The marginal ^ta^us or an Rx has £mporta^vjb .implications ,for its 
perfqniance and relationships. For one thing, it implies that* an Rx 
x:;ust ass^jne that organizations In .fclbser contadt-with ther practitioner * 
-.'aijid responsible for technical assistance in^ implementation are, in - 
^fact, capable and willing 'to use R&D outcomes^. It, also implies that * 
Rs.:^3t: assune that, members of its orgaifizatlonal network are 
1 ling' to participate) in tlie communications^ system being developed 
r dis3=rination and ,fe^d-f6rward of R&D outcomes. These ass^mptsl^ona , 
liowever, naT .tenuous in a number Rx networks. Rxs also operate^ ' 
within a set rf i:nd erstandings about the way Jcnowledge is disseminated. 



The shartconings of present practice are the problems to whi,ch th^ ]Jxs 



,ch tn^ i$xs 

must address"^themselves. Their iiana;§^ers wfll need to be knowl^ge- 
able about these problems* and aware of b^ie options -ayailable to Rxs 
foy dealing with them. , ' ' 

Rxs and Th^r > Organizational '&ets ' \ • 

; 9 ' \" ; t 

•:Arf'Rx is not only a part of the KPU System. It id also embedded ^ft a ^ 
network pf regional organizations tbat a^e enga^ed^ iji dissemination ^ 
functions of a similar or *rel^ted nature. It i^' essential to recognize, 
however, that:, although the, organizations with which^an Rx wili relate ^ \ 
have similar concerns, ^ they also can be expected to 'vai^y in iinportant 
'resp^ts on a r.uz:ber of dimensions that will influence their perceptions^ 
of, and relationships with, an Rx.* We now sp^ify some of the more' , 
important cir.ensions on whiph members of an Rx^p organization self 
may var;^ t>;at can have significant effects on how they* will relate to it, 

"... . Q ' 

The first is" the number and intensity of ^thei-r oim* intfemal problems, - 
Among the organizations .in a network, ^some, of them, for example!,^ the 
SEAs, tnay be already centrally involved in numerous and complex problems - 
'related to dissemination efforts and othej, functijins and. busily ^- ^ 
engaged in ^ multiplicity of activities designed to cppe wftii them* ^ ^ 
Other organization^ members, iiow&s^er, fiiay have reached only the planriing 
.]^ase of th^ir dissemination etfort^ 'Furthermore, the member organi- 



.zations in^thefset hdve their own imique internal organizational 
problems an^ this cdrcimstance can be anticipated to influence the 
way that they respond to interorganizational issues of primary concern 
to an Pjc.. ' Since the nuBber and types of prAbleins\o 'x^hich these 
organizitjCicns are exposed vary greatly, their reaction and committment 
^to and involverient in pro{io5ed collaborative ventures will also vary. 
' In addition, within* Rx regions the SEAs differ considerably with 
respect to their dissemination capacities. Among regions, some Rxs 
are more capable of providing technical assistance in dissemination 
than others. In consequence, the perceptions that different organi- 
zations i^ll^have of proposals about dissemination developed by dn 
Rx can be, anticipated to be highly disparate. 

' ' / ■ ■ 

A second resfcect in which they can differ is In the scope and type 
of functions they perfo R&D Labs and Centers, for example, are 
concerned prinarily with the production and transformation of know- 
ledge whereas SEAs and ISAs perform fa^y functions in addition to 
R&D, which usually is not perceived as one af their priority activities., 
A thir^ way in which members of the organizational set can vary is in 
their dissemination capacities. Although a few of the SEAs appear to 
haVe developed comprehensive and coordinated dissemination programs, 
the capabilities of most? menders of the organization set of an Rx^ 
appear to be relatively immature. ' It also deserves note that the 
dissemination papab ill ties of some of the Rxs at ^present are as under- 
developed as those of the SEAs with which they are working* A fourth ^ 
basis on which they vary is organizational flexibility. The constr^nts 
under which member organizations operate may vary greatly and th^y 
can affect their ability to allocate resources to new efforts, ,establi8h 
new organizational units, and to collaborate with other organizations 
in the set. • _ , , * . • 

A fifth basis on which they may<»vary is in their predisposition to 
become involved In a new set of Interorganizational relationships^ 
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Sone organizations caj' feel threatened by the new endeavor, whereas 
other^nay welcome it'. A sixth' basis on which they may vary is in 
terns of their probeblB organizational longevity. While SEAs. are ^ 
likelv :o be present ror a long time, the longevity of an Rx is 
uncerraiz. Furthermore,^ the turnover in personnel working in Rxs and 
other i:i3ccura organizations, may inhibit the development of productive 
working r4l= zicnships. The fact, that the'Rxs are dependent on NIE 
for funcizg directs their stability in^view Qf its annual budgetary 
dif ficulties, A seventh differentiation is in their leadership 
capabilities, staff experien^Bv^d competencies.. The organizations 
can expecced to vary in their capabilities to offer leadership to 
dissemination -Efforts. They also can be anticipated to vary in the 
knowledge, technical skills and human relatipns of their staffs. 



An eighth respect in which they may vary is in their stage of develop- 
ment as a disseniination agency. For example, some SEAs within the ^ 
organizational set of an Rx may be in the eajrly stages of developing 
' dissemination services whereas others may have already launched 
substantial F^-Srams. A ninth basis on which they may differ is 
in their involveaenti in "the inner circle". Because communication - 
does not flow 'jnifornly and regularly through a configuration of 
organizations, an "insiders-outsiders". situation can* readily occur. 
Critical infortiation tends to be shared among a select subset of 
organizatior.3 in individuals. A tenth difference is In the iegree 
to which the7 ar§ in close contact with school systems. Organizations' 
in the set that have ^direct and on-going contacts with local school 
districts vili perceive themselves as being more in touch with reality 
than these* that have limited contacts with educational practitioners. 



An eleveath vay in which members of the organizational set 'can differ 
Reserves special enfihas'is because it can markedly influence their 
perceptions of RDx. TKe Regional Exchanges and the support contractors 
'are cocpcnents of indivitiual-L^s or Centers and are thu| controlled 
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by them. This circumstance has resulted in the belief that the Rxs 
were created to serve Labs and Centers by disseminating the^ir products 
to practitioners* Lingwood addresses this issue in his paper in this 
volume . 

Since iDrgarizations in an Rxs network can vary iii so many respects,, 
this circimstance will exacerbate" it's interorgani zational problems* 
It will need to be constantly ''taken into account in working with other 
organizations of the set* The differences that exist among the 
agencies involved in the organizational set of an Rx suggests that; itiS 
services to its clients be tailor-made. By maintaining flexible 
arrangements with them, the Rxs should be able to address the individual 
needs of e'ach SKA or ISA. Flexible arrangements will also be required 
in the relationships between Rxs and Washington. What is needed" is 
guidelines that are broad enough^ to permit cuistomization of an Rx^s 
strategies and tactics. * * 

' ' . 

' INTERDRGANIZATIONAL^ RELATIONS PROBLEMS • 

Serious impediments to the development of productive working re la tion- 
ship9 aiixong organizations engag^ in collaborative ventures can readily . 
arise. We now consider obstacles of this kind of special relevance 
to the interorganizational rel^tionsh4.ps of the RDx. ^ 

Three types of issues will' be examined. The first fpcuses on organiza- 
tional role prolfxeins auad those involving staff overload. The secq/ad 
concerns deficiencies in interorganirkational linkage* arrangements. ^ 
The thir^ deals with maifa^ement and ]|eadership prbblems* For each 
issue to be considered, We ^halL present and briefly discuss one or 
more propsitions and then inquire about theit implications for the, 
design i>f an Rx With special reference to ^the development of productive • 
working, relationships among members of its organizational se£* 

. . N • •• 



195' 



21 



Organizational Role and^St;aff Overload Problems 
New, Organizations as Perceived Threats 

Proposi'ticn 1: vo.en -a New Qriganizatiaii (NO) enters a territory to 
provide s^r'.'lTcas 3iiiile.r in nature to those offer,ed by Existing ' 
0rganiz = iir;^5 'IPs) . tzere is a strong likelihood that some members 
of the ECs 11 ';>erceive t^lie NO as a threat to their own personal 
well-being rc the welfare of their organizations, despite the 
diaclainers zz The ^N0 . , . . . 

Proposition 2; The greater the ambiguity or vagueness of the NOj^ , 
functions and services as "perceived by the ^Os, the mote likely, the 
will perceive the NO as a thr^^t . 

As noted, the increased attention giVen to dissemination at all levels 
of education in recent years has resulted in a multiplicity of agencies 
being engaged in this function. In consequence, when an Rx initiates 
its activities , It will#be entering an aretra in which a -sybstantlal 
n\imber of organizations ar^ already involved^ Organizations such as 
SEAs and the EP^IC Clearinghouses Mght readily perceive that an'Rx ^ 
will engage in tasks thait' duplicate those in which they are alread";^ * 
involved or Tlan to under t;ake. 

As a recent £ntry, into the configuration of organizat^ns ;engaged 

in dissenination, Rxs have attempted to cairve out a role for themselves 

that would uiinisii^e conflict with ag^nqies ii\ thieii* orgc^i-^ational^ 

network and th^t would contri-^ute to^ the ^evelopiient of a nationwide \ 

V VI 

dissemination effort. ^However, this .definition of the, r^Ie o^f~an IS 

lacks specificity. Agencies' such as an SEA fian be eKpe^e'd to be* 

reluctant to work with an Rx.^inCe they are undlea^ abofjit^^its^ specif i<! ' 

tasks and whether it will^ atjiempt to take^^ver some of th^ir functions. 

Since the urtique contributions of the RjfS reirfain' uhs'tife'qlfie^^^ 

existing government documents, ,tiierc appears to be justif ioat^ioj for 

their concerns. 



i 
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TKe role definition problem also presents a dilennna fQr the Rxs. On 
the one hand vague and broad statements of their purpose make it difficult 
for than to justify their existence. From a marketing perspective 
(Kot^er ^ ai. , 1977) x their specification of a distinct "product line" 
or service is esse^^tial. On the other hand, specific statements of 
purpose leave them little room to negotiate and compTTomise with members 
of their organizational sets. ♦ \ 



V 



AncJther aspect of the role definition problem is that some SEAs , ISAs, ^ 
an<f LEAs do not perceive Labs and Centers as having a strong previoxis 
track recojrd in providing them with useful services. As Bean and Rogers 
(1977) indicate, research activities in education appear to be (Conducted 
Idrgely in response to researcher's needs. "Labs and Centers, therefore, 
often^find themselves in the position of attempting to find prarctical 
^i^s for their research and development results. » The practice of 

rma^^ing*' research outcomes to practitioner needs, however, is increa- 
ingly b^ing viewed as a dubious procedure since 'it often results in 
a "charige advocacy" role which increasingly^ is being seen a^ati impedi- 
ment to iraplem^ntatiott (Kotler et al . , 1977; Rogers and Bean, 1977J 
Fullan and Pomfrete, 1977). The statement that one of the obj^ectiVes of 
an Rx should be "improving practitioners capability (sic) to make \ 
rational decisions to select and use high quality R&D and other outcomes"^ 
Implies thal^: (1) an Rx will work, frequently ^ith LEA^^ C2) LEAs 
frequentily dq not\iake rational decisions; and (3) many LEAs lack the 
■> capabilities for pftfbnal decision-making (underlining ours). TWe 
\ first st&tement is incongruent with other pronouncements- pf RDx ^d ^ 
could readily be viewed as threatening by SEAs and LEAs. The, other two . 



may have some basis in fact. However, they could readily ,])e^iais cons trued 
and could have' serious negative public relations coissequences for an Rx* ^ 



Implications 



In view ofl the role definition problems confronting the Rxs, ^-Propositions 
1 and 2 ha^ important implications for them. They imply that Rxs must . ^ 
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delivar useful products or services which are perceived by S^s*, ISAs, 
LEAS, aad ojEher clients as filling major unmet dissemination needs or 
as having a' distinct advantage over other available products and services. 
Tne prepositions also i=?ly that Rxs will need to validate their pronoun- 
cemenrs a:;ut their inrantions as quickly as possible. If they do j^ot, 
they ca- anticipate exposure to increasing distrust. To achieve these 
objectives, cni or nore of the following strategies or tactics may. 
be highi7 fjnttional for an*Rx: (1) initiate relatively quickly 
a .modest orc: = :r or activity that serves to .validate the Rxs public 
definition =f its role; (2) provide constant reassurance to EOs fo , 
reduce fears- or uncertainties they may have; (3) involve officials with 
stature and pover at the national level in meetings with the EPs to , 
corroborate R-xs statements about its functions and role;- (4) establish 
a consortium-t>-pe arrangement in which the EOs and the Rx. jointly 
agree €o a division of labor with regard to their respective regional 
tasHs; develop > written agreement acceptable to all parties .about 

their respective roles, rights and obligations in their collaborative 
'or conjunctive relationships and undertaki^s ; (6). maximize "natural 
processes" already in existeAce^hat facilitate trust and confidence, 
(Zaltman and Sikorski, 1977) especially in the early stages of relation- 
ship-building; and (7) make clear to EOs the rewards and benefits to, 
be derived trio collab'oratfng with an Rx. ... 

* ' » • ■ ■■■ , 

Role Overlc'd tor Organizational Members 

' Proposition 3: A condition that hSs freque ntly conitituted a ierious 
Impedinant to inolenent in ^ nrograms developed or sponsored V a seqfof 

. oreanization-s is the role over-load to which Its members are exposed as 
a consat-Jcnce or their partici pation in them. ^ 

Organizations- that become involved in collaborative ventures generally ' 
^ fail to consider w^iether their staffs will be able- to carry out in a ^ 
competent aanner, duties necessitated by their new, relationships . 
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Their ^ei^sonael frequently cannot behave in* tjjis manner since their ^ 
^ ,^time is already fiilly committed or they lacjc^ the required skil3,s. / 
When organizational neoibers are required to assume added responsibilities^ 
it often results in their being assigned time consuming tasks which they 
have difficulty ^n completing and that compete with their ongoing duties. " , 
Exposed zo ir.coapatible expectations, they find it difficult ox impossible 
to carrx out both their old and new responsibilities effectively. ^The 
role overload and role strain they^xPAt^ence results in personal feelings 
of ambivalence, frustration, and stress. These conditions can also have 
organizational and interor^nizational effects: their organizations 
will find it'^ difficult ot impossible to conform to the expectations of 
Che otfter organizati^s with whom they are c9lla*borating 4nd to meet . 
their commitments to them. In' short, i^terorganizational programs can 
suffer^ as a result of the failiire of their members to examine in a 
hard headed manner the 'new role, demands that their Qollaborative endeavors 
will entail, and their capabilities to fulfill them. In seeking" to get 
its^ot in .the dissemination *door , an Rx bfe sorely tempted to 
attempt to meet most or all of the demdnds of , the SEAs and other agencies ' 
in its organizational set* ^^^^^ follows this approach an Rx will be 
^ promising services which are beyond its capacity to deliver, eith«;r 
V because of time or personnel^ iimitatioi^s. Unmet expectations in 

situations of this kind generally have dsyf unctional effects on^^sub- 
^ sequent interorganizational relationship^, tfv ^ . • * 



Implication^! ^« , > ' ^ ' ^ 

Proposition 3 ijiq>lies that, ip developing' new programs of a cooperative 
or collaborative nature with members of its organ izatfipnal get, an ^Rx 
needs to determine their capabili£les tp implement theit proposed res- 
ponsibilities. It also needs to* examine its own capaliillties to carry 
out its proposed commitments. If the Rx or other members of the organi- 
zational set lack the persor^el and other resources required to' carry 
out*their assigned duties ^nd if these deficiencies cannot be cor»rected, 
then there- id little point in Embarking upon the collaborative effort 



ERIC ' . , , IBB 



25 - , 



since there is little likelihood that it can be implemented. Further- 
,more, the proposition suggests that Rxs may need to giVe serious consider- 
atior. *o the following idea subscribed to by soma management consultants: 
whan an organisation or a set of organizations decide, to perform a new 
fVincrion, they probably need to establish"^ new set of structural 
arrcr.girer.rs and rolas for its accomplishment. This strategy by-passes 
the prcblei^s of role overload and role strain and permits the develop- 
ment of 3.' izilcr-nkde'set of arrangements to accomplish a new function 
or missirc." « 
# 

• Unrealistic Tlains . ' ' 

'Proposition 4: Organizational representatives involved in cooperative 
or coUaborative v entures with other organizations frequently overstate 
what thev caa accomplish, underestimate th e time" required to achieve 
proposed oobiectives or underemphasize thte con straints to whjch they will 

' he g >.-i)03ed. Tnev glso often "tend^^be un realistic about the contribu- 

tions their organi zation will be able to mak e to ehe proposed ug^er- 

" ; ' [ « , « . 

taking. > If fne <fenture is launcked^ it does not take long "for the - 

participants to realize that thev hav4 beco me involved in a collaborative 

activity that will diraw upon their, limited reso urces but has little 

. probability of achieving its stated ob-^ectives . 



Members of an organizational ^et can be expected to overstate their 
past acco=?li3hient3 and their actual or potential capabilities for 
ma^iy reas??.?, for example, unbridled enthusiasm, lack of experience, 
or ir.corn)erency. Regardless of its cause, this lack of realism 
'generally results in distrust for,, and negative re^^tions to, some 
organizacions in the set. If an Rx engages in this type of behavior, 
it will reduce the credibility of its programmatic efforts and its 
personnel. * , 

Implications ' ' ' ' . ^ ' 

Proposition 4' alerts .Rxs to the negative consequences that can follow 
fJoQ overconnaitlng or over-extending themselves, especially jiuring the 
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early phases of their deve^lbpment . It implies that their efforts need 
to directed, at doipg a iew things well rather than engaging in^ ^ ' 
large variety of acti>^iftles . It also .suggests that serious consideration 
may need to be given to staging or sequencing their several, tasks and , 
to engagir.g initially in a few activities in which the likelihood, of 
success is relatively high. In short, the proposition impMjes that-Rxs 
need to assfess paalistically their own capabilities and priorities and • 
be aware or t.-;e importance of strategy and timing considerations in 
planning theic programmatic efforts. 

- N " ' • ' 

Dfeficiencies in Interorganized Linkage Arrangements 

Proposition 5; A circumstance tha't frequently inhibits the dev^elopment 
of productive ^d harmonious relationships among orsanizatfions engaged 
in copperative or collfaborative 'ventures is the^lack of mechanisms 

to monitor their activities and to fa cilitate open and. frank comauni- 

_ — ^ ^ — , — , „ p. — - — - 

cations about substantive issues and procedural matters * * 

The individuals who developed the initial design of the Rxs did not 
include their potential clients on |:he basis of the . information i^ailable 
to them, many of them had the strong impression that much qf the system 
was not open to Mdilf ideation. In additiori, the inf requent \Crff Icial 
messages received by agencies engaged in disseminatijLon activdti^es 
were at tiiies ambiguous* The lack of frequent atid open* communications 
has created a serious ''insider-outsider" problem. It undoubte^y 
accountfs in part for the antagonistic feelings that have developed 
•among some organizations, particularly the SEAs, toward the Ibcs.\. When 

Rxs later opened channels of commtmication, SEAs were frequently 

\ 

unwilling or reluctant to use them. * * , \^ • 

Impediments to' open communications exacerbate the insiders-outsiders . ^ 
.p:roblem. Just as the sophisticated linker searches for gate keepers, ^ 
so also ^11 an Rx attempt to identify gate kee||^r oxganizatidns and 
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-individuals to work on important issues of central concern to an Rx. 
An needs to be alert to ways of minimizing the irisider-routsider. 
prcblen. It ^^-s to gS-ve special' attention states not presei\tly^ 
invoy/^d i?. tfte RC:< and to agencies not presently involved in the Rx 



service structure. 



Implies :irr-s 



An Rx naefs rr establish as quickly as possible mechanisms that- will 
perml^t the organizations they cooperate or collaborate with to obtain 
the types of i:iforcation they need to perform their Rx-related respon- 
sibilities. Competent individuals need to be placed in charge' of 
these mechani^sms so ^that the messages sent ^ill be clear, candid and 
imeqiiivocal and bo that the receivers develop a positive Imagfe of Rx 
and a feeling that it 'is "on the ball." It also^eeds to^co^uct its 
relat^ionships with members of its organizational set in ^ candid and ^ 
•open manner. Such a posture will encourage them to respond- in a 
similar way. Oifganizations with whom an Rx will*work may feel it ' 
necessary to hide or cover up "embarrassing* facts" that' may have an 
, important bearing on their later relationships with it» Stressing 
the idea that all organizations, including Rxs, are imperfect anci 
rewarding cazdor generally facilitate open and frank connnunicatj-oh. 

The Absence or Inadequacty qf Croundrules > 

Proposition 6: Tne absence of g^roundrules ip collaborative ventures 
among pyg^r.izatlons or lack of clarity about them» if they exist » can 
serve as a serious impediment to the development of productive inter— 
organizational relationships . ^ • - • 



\^en initial discussions are held about possible collaborative activities 
between a new organization and existing organizations,, the deliberations 
^ among their representatives tend to focus on broad issues of general 
concern to the several parties, for example, the goals lof the proposed 
cooperative venture, its costs and benefits,. thegoVerall division of 
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labor ahong participalting organizations, and related matters. Little 
attentiolP, however, is usually gl,ven to establishing the groundrules 
needed to rake a collaborative venture successful or to cla^pifying 
thos§ established^by funding agencies. Furthermore, when groundruleg 

are established, a nimber of them may be ambiguous and they 'may fail 

*\ 

to specif V hew the following kir^ds of important matters will be resolved. 
Settling disagreements among organizational members, allocating available 
resources, ^ieternining who has the right ^o make what decisions, and 
the obligations and.righ'ts of the p^r.ticipating organisiation. Since 
groundrules are unavailable or ambiguous, procedures are 'unavailable tio 
deal with pressing and important interorganizational issues that will ^ 
probably arise; hence, the absence of groundrules or their ambiguity 
can serve -aS'^pedim^nts to efficient and effective interorganizational* 
relationships. 

Implications * i * 

It iff essential that groundrules be established between an Rx and 
members of its organizational set prior to their engaging in cooperative' 
or^ collaborative Relationships. If an Rx enters into a sustained relation- 
ship with one, or more members of its set, groundrules also ♦need to be 
developed with respect to their working relationships. They should 
specify tbe^ rights, obligations and duties of the participating organi- 
zations, and indicate thti procedures' to.be fallowed in lian'dling disputes 
.and conflicts. k ' 

Premature Agreanents; . \ . ^ . ' 

Proposition 7: Organizations thaf are new to a territory frequently 
' enter into agreements with existing organizations before ttiey obtain 
reliable knowledge about* their. strengths . weaknesses and capabilities . 
If it turns out that one pr 'more of these orfeanizations lack the 

. — , ' 7— ^ 1% - \ • 

capabilities ^ne^eded to fulfill its obligations to the new organization 

then \X will be exposed* to serious difficulties 'in accomplishing its 

^ ' T j \ 

object ives . * * . . * , ^ • 

— ^ ■- * . ' ■ ' ^ 
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The views' thai: 'an R:< inicia^lly holds :abaut a meTd^er of its organiza- • 
•tion^l-set iay be ina.o^curate because, the information available -tjo it _ 
may^^e ln«.=?lete or erroneous. In addition, its perceptions may 
Reflect tb/ii:2ited- positive, or Wtive experiences of its staff 
members type of or^aiization." for example. R&D iabs or SEAs. 

If a8r^£:^--3 -2 e-r^-ed intc^ by 'an Rx with members of its organiza-^^ 
tiona^s- l-=^-=-e based on inaccurate assessments of their capabilities 
then thav yi- probabjy be unable , to fulfill them. H^nce. 'the likelihood 
is' great tha- proposed collabota-tive' disseMnartion efforts will fail. 

Implications ^ ^ ^ . 

This p^pJaiti^n implies- that Rxs n.ed to be^especiklly cautious about \ 
entering into loAg-ter; agreements "with existing organizations and ^ 
supporting their long-term proposals when they initiate their regional 
activities. In addition,' it implies that Rxs need to keep constantly^ 
•in mind tSat;" as noted e-^rlier.. agencies such as ^ate departments of 
edupaVon^ar intermediate units. are,\.ot in.te?changeable units.. They 
varj^ markedly- -i.. their organizational capabilities, in their ability . 
ta^«i?e .'their own resourced for^tfissemination purposes; in the- 
■perStl available to tUm for t}. is task, and in their quality. .. 
short;' an ^^..^is to engage irf^l .ystemattceffo.^I^o identify ind^; 
vidual' differences- ^ong members ^f, Ita, orggAizational set and i:his . ^ 
infotmation heeds to be used in m^k^ng Vecision-s about allocating its 
resources and in developing its 'prpg^^^'^ ac^ivltie.'. Since m^embers 
' of anK«s organization set can be expected to vary in their capabilities 
- a-f.d Resources. It will also have to make ^ fundamental policy decision: 
should. it ^Prisarily collaborate with, and support existing orsa;,izat Lons 
~ with-a*proven record c?f success or those with no or poor track records 
in thfe past *ut that appear to have real potentialities for providing, 
needed- dissenination. services for the region. , - 

• Management ar>d Leadersh ip Problemfs ' ^ . ^ ' * . . tf 

■l' ■ , . - - . • . ■ . . • 

^ inept Management and Weak Leadership ^ . ^ 
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proposition 8: Majot contributing fa c/tors to the failure of ventures' * 
involyini? inter organizational relationships are frequently their weak 
or ineor bana^enent and^he lack of leadership e:diibited^by individuals 
who aa::a£e ong or more of 'the participating organizations . 

The activitias of the R5cs will involve collaborative relationships ; 
with members of its organizational set designed^to ^disseminate high 
quality services and products, upgrade consumer information about 
.R&D activities, ma|ce R&D activities more responsiv^ to school system 
needs, and in general to upgrade the perforinance of schools* Each 
of these tasks is complex and will require planning and programmatic ' 
eff ort%^ that will encounter n'uii\erous barriers when attempts are made , 
to pperationalize then^ Skillful management and the exercise of 
considerable leadership will therefore be'requ^t'ed if the objectives 
of Rxs. are to be achieved.. Furthermore, it can be anticipated that 
the way those who hol4 subordinate positions in the Rxs define and 
perform their roles and relate to the members of its organizational 
set will be influenced greatly by the attitudes and ro3,e per^rmance 
of their superbrdinates . Personnel selected to -mamage new governmental 
tinits l)ave on many occasions lacked the requisite commitment, technical 
competencies, administrative taiepts, and human relations skills 
needed. to meet the requirements of their demanding roles. i 

Implications 

Prdposition 8 implies^ that a critical factor that will influence the 
success or failure of programs of the' Rxs will be the quality of leader 
•ship exhibited by those w^io mainage them. This in turn indicates that 
a priority task of those responsible for the overall management of the 
RDx will be to find top-flight personnel with leadership capabilities 

m ' ' 

to fill key management pj^sitions in the Rxs. 
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Poor Plar^ning • * . 

V 

Prcpositicn 3: A circizi3tance associated with many of the impediments 
\earlier cc-sllered, and one that has, been centrally involved in the 
wreckage cf nany collaborative efforts, is poor planning . 

The goals :f z'zetr aciivities were frequently fuzzy or difficult to 
operationalizr. Their adminlstratoj-s did not specify short-run, inter- 
mediate, or lr-2-run targets to be achieved and hetice the^ were unable 
to design strategies and operational plans to implement'^ them. Their- 
^^ld:anning efforrs typically failed to take into account 'that the way 

Sa^ pr opposed program is initially presented to organization member^ will' / 
have a crif ical bearing on their initial reactions to them and their 
motivation to implement them. They gave little thought to the imple- 
mentation obstacles ^that could be anticipated to arise during' different 
* phases of their programmatic efforts and to mechanisms that could be 
established to Identify and overcome them. They showed little awareness 
that institucing new arrangejnents or programs of an interorganiz^ional 
nature is a dynamic and complex process that requires skillful management. 

*Impli cat ions \ \ 



Proposition y trplies that Rxs need to make members of their organizational 
set aware chaz^ systematic and careful planning is essential for the 
develop.'zent of successful interorgani?ational programs and they need 
to denonotrate its utility for theff joint activities. It also implies ' 
that the Rxs nay need 'to take a hard look at their owu planning efforts, 
and if necessary, design more efficacious strategies and procedures 
to achieve their targets* Furthermore, it suggest^ that if Rxs find 
that the planning practices of the SEAs or ISAs with respect to t^ieir 
dissemination programs are inefficient o;- dysfunctional, they may. find 
it efficacioi;s to support in-servfce training programs that focus on 
strategies^ and procedures of planning. The importance of systematic 
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and careful planning for their collaborative endeavors needs to be 
constantly enphasize^'d. ^ Joint planning activities need to be given 
a high priority on the agenda of meetings between Rxs and members of 



their orgar-i^aeional s^ts 



Def icie'ncicis ir. Personnel Performance 



Propos^ition 10: In establishing new organizJUions cons iderable time 
and effort is usually expertded on designing their structural arrange- - 
ments and preparing job descriptions. Muc h less attention is devoted 
to engaging in a careful search for and -selecting personnel w ho possess 
the capabilities required to fill their roles in a compe tent mnner> 
In consequence, the role performance of me mbers of the new organization 
is often deficient when they serve as organ izational representative. 
When this ^condition exists, it will serve as a major impediment to 
developing harmonious a nd effective relat ionships between a new organi- 
zation and members of its organizat ional set. 

If sericgis reservations about the capabilities of the representatives 
of a new organization are held by members of other organizatiojis 
as a result ol their initial contacts with them, this circumstance can 
serve as a serio'us barrier to the development of effective collalforative 
relationships. In the rush of activities that marks the start of a 
new' organizational venture, staff selection and development usually 
•.takes a back seat to the political problems of nurturing ^nd protecting 
the organization and its nuts and bolts problems. In tlj,e case of Rxs, 
many of their pe*sopnel can be expected to be recruited without adequate 
preparation for their new roies. . \ 

Implications ,. t • 

In view of th4 varied and complex responsibilities of the Rxs, the 
distrust with which their activities may be perceived by officials of 
some SEAs and other agencies, and the importance of othei; organizations 
to its dissemination and related objectives, a concerted effort needs 

=2.07 



to be nade to procure ^taf f members of top*f light quality who possess 
exceller.t technical and human relations skills.. In .addition to possess 
a fim grasp .of available knowledges^about dissemination, educational 
char.ge strategies,^ iapl^entation obs't;^acles,^ and related areas in both 
the s-cciai sciences and education, they will need to po$^ess skills •in> 
interpersczal relations. They will also need to obtain an understanding 
of the frr^l and i^^raal social structures o^ their ^regions and the' 
organi2=:irns vlrh ^.t.ich they .will work. If resistance to or distrust ^. 
pf an £.ri==.s in its region, its st^f members will find training 
in strategics zz Attitude change gf special value. 

) 

Absence of Feedback and Monitoring Mechanisms 

Proposition 11: Lack of monitoring a^nd feedback procedures will serve 

as serious obstacles to organizations engaged in cooperative or collaborative 

activities * 

Th^ absence of these mechanisms largely precludes e^rly identification 
of impediments to productive inte^organizational relationships and 
hence, the ability to determine their causes and to deal with^them " 
promptly. .'Their establishment is essentiaUif a^prqgram is to proceed 
in an Orderly iianner and with a sense of direction^ to its objectives. 
They also ser-.-e the important functions of riihcov^ring the stresses, 
strains, and frustrations of personnel involved in new programs and 
of underscoring the need for staff sessions to examine ways to cope 
with its external relations problems. If major impediments to an inter- 
organizational activity are not ^entif ied and eliminated, they can 
readily snowball, get out of hand and lead to its abandonment. 

Implications 

Proposition 11 implies that Rxs should strongly encourage members of 
their organizational set. to establish monitoring and feedback mec-hanisms 
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in their cooperative or collaborative ventures since they- constiJ:ute 
desiderata for developing effective interorganizational relationships 
• and ''for .the inp lamentation of their plans. Furthermore, in .stressii^g 
the ii^porran^e of these mechanisms, the Rx needs to emphasize that 
J:hey. cor.^zitute facilitative, not evaluative, procedures. This suggests, 
that the r:er3, formative evaluation,,, be dropped and that it be replaced 
by **jEe'edDack" and ."monitoring" devices. - ' ^ 



IV 



STRATEGIES AND PROCEDURES TO gJEDUCE^ IMPEDIMENTS 
.TO PRODUCTIVE INTERORGANIZATIONAL RELATIONSHIPS 

'^We have considered a number of conditions that could serve as malor 
impediments to the development of productive working relacioiiships 
among members o§ an organizational set and have S\Uggeste<f options 
available 'to an Rx exposed to them. The obstacles we idiVitified 
constitute potential {)arrier»*^^at occur with considerable frequency 
in collaborative ventures amotig organizatiohs ; however, they do not 
invariably arise. I'/hether any one o^ these iiapediments will arise 
in a collaborative endeavor of aa Rx is problemafifc. Th^ir occurence 
will be a function in part of whether the officials who manage^ an RDx 
pursue courses of action and institutJ^ procedures designed to minimize 
tlie likelihobd that they will arise. What types of - strategies and \ 
procedures could 'an Rx follow that would decrease its chanccis of 
encountering serious problems in its intetorgani^ational relation-** 
ships"? I'/hat conceptual schemes could gulkde its efforts? We now 
offer si3^ observations that bear on these questions. 

The first is that an Rx can make a systematic effort to identify 
the kipds of serious obstacles that are likely to arise, during the 
several phases of its collaborative ventuj^es. One Rx strategy that . 
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could be highly functional ±xx this respect would be for its staff ^ ' * v 
collectively to develop an obstacle dourse flow..chart that 'specified ^ ^ 
its -•erce::rion5 of tne =:ajor difficulties t\iat would^ arise durj.ng 
its coll=.r::rative effcrt-s arid its views of -their probable causes. 
This tvte if ola:i:iliis activity, especially if conducted on a contin- 
liing basis J co'iLz be ^luable for several reasofis/ First, it identifies* . 
potential rarrlers. Second, it focuses attention on the types of 
conditions r'-ai create them. Third, it leads to deliberations abput; 
courses of aczirr. that might be pursued to prevent them. Fourth,^ it 
alerts staff nenbers to the impact that their awn performances have on^^ 
reducing or increasing the likelihood that potential Obstacles will 
develop into serious impediments. Fifth, viewing potential obstacles 
along a time line brings out in bold^ focus how barriers to productive 
3Lnt;erorganizational relationships may^'be intertwined* For e^^ple, 
an Rx^may >^nticipate that several key members of its organization set 
Will refuse to become involved in a collaborative activity of^special 
'importance to iVf.=jcause. of their fears that the Rx wil^ attempt to 
ln.textej:j£„ with_. thei^^ An ^an^Vsis of the obstacle 

cou3;se chart may indicate, however, that if these members of the 
organizational set perceive at earlier stages in their collaborative 
efforts that ?oc officials have no^ intention of >ecoming involved in 
their current: Activities, their opposition to the new proposal may 
disappear. 



The second observation is based on the idea that the performance of. 
an Rx during the. initial phases of its relationships with, members of 
its organizational set will probably 'have an especially significant 
impact on t;he nunbet and types of obstacles that it will encounter . . 
later. More specifically, if officials of an tlx do not or cannot clearly 
^ecify. at the outset of their relationships with i^embers of their 
organizational set the functions the/ .propose to perform, or if members 
.of the organizational set view their presentation as fuzzy, then these 
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conditions will probably result in serious impediments during subsequent 
phases 6i their relat^.onships. Furthermore, if Rx officials in their 
\lnitiar neetings with members of thel^ organizational set equivocate 
In respoiiding to legitimate questions , about fiscal matters and issues 
delated to their division of labor or- autonomy, then the seeds will be 

\sown for punerbus impediments that can be expected to inhibit the later 
development: of productive interorganizational relationships. If initial 

' meetings called by RDx officials are poorly organized and reflect a 
cavalier attitude toward planning, tjj^n many problems that could have 
been d^Lt with effectively and expeditiously at these gatherings can 
be expected to disi^upt later stages of their relationships. 



To minii^ize the Likelihood that such dysfunctional developments will 

occur, lixs need to devote considerable time -and effprt to engaging in 

i 

the homework and p latin ing needed to put their best foot forward in 
their initial contacts with members of their organi5:ational set, They 
ijeed to lay the groundwork for reducing ot eliminating the noise and 
other obstacles that can arise in their subsequent relationships. 
They need to be prepared to answer in a candid and straightforward 
manner |he questions that members of their organizational set have a 
right to, and can be expected to, raise. They need to propose ground- 
rules that will facilitate the development o,f effective working relations. 
Since the quality oTE^the performance of RDx officials during their 
initial contacts with members of their organizational set will probably 
* constitute a major determinant of ^the number .and severity of problems 
that thepr will encounter during su^equent phases of their relationships, 
jthey need to be certain that theiiFot^m house is in order before they 

engage in transactions with them.^ In short, administrators of an RDx 

1 * * 

need to be acutely aware of the impact that, their performance in* the 

initial jihase of 'interorganizational activities 'can have on its later,^ 

^^phases and vie<^ their petformarice during this period as a maj W-deter- 

' minant of the number and type of obstacles they will encounter later. 
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The third observation about s^^rategies and courses of action that an 
, Rx;can er?;.oy tVninioize the likelihood that ^ serious iftterorganizational 
probians.vill .arise deals with the priority that an Rx assigns to this. ? 
.task. ^ Ve' have ziaintained that the. development of effective working 
rel^titr,5hi:?3 with ^lezbers of its organizational set is an essential 
prerecjlsiza for the success of an Rx, In operational terms, ^lis 
i^ea^^^-v£- ^-tics of one or more staff members should focus on 
TnoMt^yring zhe extrtmal relationships of an Rx, alerting it to actual 
or pptenrial irpedixents tp its existing or planned programmatic 
efforts, and proposing/strategies to deal with them* An ad-hoc 
approach to these tasks Ts generally of little value. They ne^ to 
be approached in a systematic and continuing manner and with dynamic 
atid holistic perspectives. If organizational interrelationshit)S are 
to be monitored. effectively, if careful analyses are to be undertaken 
of the .state of existing and potential impediments, and if. strategies 
are to be developed to remive potential barriers, then these important 
tasks need to be assigned to high level Rx personnel and they should 
be given the budgetary support required to perform their important 
responsibilities . * - , , 

The fourth observation pertains to the Value of conceptual schemes in 
effc5^ts to'rei<5e« impediments to collaborative efforts and to sftrerigthen 
interorganizaziDnal relationships. Wh^t^an Rx requires is a formulation, 
'.that specifies its objectives and then indicates the stages through ^ 
which it nust r.ove with members of its role set .to achieve them. The 
'model davel6?ed by Gross and Harriott for the analysis of the ^dynamics 
of planned educational change is suggestive in this connection. It 
assumes thar a successful organizational change effort goes through 
five sequential stages: exploration, strategic planning, , initiation 
of the innovation, implementation arid incorporation. It could be . 
argued that successful collaborative efforts between an Rx and its 
organisational set also Requires traversing a similar set of stages. 
If critical issues that will have a major impact on-a collaborati^ve 



212 



venture are not examined in a hard-headed manner during th^ explordt6ry 

». " • * • 

stage, for example, the capabilities of organizational set membArs^ 
'to carry ouc their proposed tasks\ ^then the failure to consider this^ ' 
issue «5iild« result in a' 'major impediment to achie\^ing iater-organization^l 
^ objectives. Similarly ; 4f. the^ strategic planning stage is by-passed, ' 
no effort vill have b^em made to identify implementation obstacles arid 
strategies tr.st could, be. ^invo^ed to over come l^them. Models of this kind 
noi only 'indicate the stages af a sucdeissful interorgaiiizational. effort ; 
in adSditioit, they 'specify the ki^ds of impediments that* are .likely, to , 
arise during eaqh o£ "the stages and hox>7"£hey may be^Aldljed. They also 
can alert the' nanagemeht of Rxs to pitialls that they can easily ignore 
and suggest strategies to avoid or overcome impedi?ients to their targets. 

The fifth observation pertains to the importance of an Rx recQgnizing 
that the source of certain serious problems it ^nay encounter may be 
the butmoded or dysfunctional regulations ^or other types' of external 
constraints to which it is exposed from agencies in Washiligton, D.C. 
* and in i^s region. An -awareness thf^-the causes of some rinterorgani- 
zational barriers are externally rooted can lead to efforts to iremove 
jthese external .conditions. If successful, they will reduce impediments 
to productive dnterorganizational relationships. 

The sixth and final observation concerns the posture that an Rx can 
adopt in dealing with potential or existing 1)arrrers to the develop- 
raent; of productive relationships with^ members of iw^ organizational 
set. On the one hand, it can tak<e a passive or reactive stance to 
Obstacles ^na attempt, to cope with them on an ad hoc basis. On the 
other, it can adopt a. proactive posture to potential sources of stress 
and conflict in interorganizatibn^l relaticgm^hips. Mafty obstacles 
that arise in these relationships are a consequence "tjf misperceptions , 
misunderstandings, or "noise" in the communications "-system.*' Through 



taking the initiative in identifying .|>oteritial or actual barriers 
and exercising leadership in devising ways to avoid them, qq: to mi 
their negative effects, an Rx can raaterrially reduce the number and 
kinds of impediments to why^ch it wiilT be expos'ed. 
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' CONaUDING OBSERVATIONS' 



in prcc?:ci:: g 52ctiras or this chapter we >k,ve considered a number^f 
problems ^-which aa & zajr encaunter in it's interorgaaizational relation- 
ships. ' ''^^zls^ ?rop.csed courses of action, to cope'with these .impediments 
and suggesTic szrategie^fhat .it might employ to prevent* them or 'reduce 
their dysf-ctl-nal effects. In ^his concluaing' section, vfe identify 
several s.trategic ways Iti whichyo^ials who will. administer Rjcs^ca^i '\ 
exhibit leadership high quality in managing their complex inter- - 
oirganizationai relationships. ^ 

One important way that Rx.managers ^n offer leadership tyS the -^Sft em'al 
affairs is to take the initiative in identifying and' dealing with ' 
potential or actual interorg^hizationali problems. By adopting a pro- 
active posture-, they can prevent some potential, obstacles from occurlng 
and minimize the dysfunctional effects of those that do' arise. The" t ^\ 
managers of a new organization are generally so" preoccupied' witW/in'ternal 
•start-up issues that they devote lijttle time to anticipaty^ng and ^ 
devising solutions f or^probleifis which v^iH p.rebably ax:ise in their 
relationships vith other drgani^ations, ^In view ^>f their functions 
Rxs also need to be centrally c^cern^d with theii; external problems. 
The skillful zzanageraent of- an Rx requires designing and implementing 
organizational ^rtangements^that assu^ tWt the Importance of its' 
external relations is f^^lly recognized!^ In ^hort, a proa¥:t4ve posture 
toward the interofganlzatiooai problems of an Rx is .essential for the \^ 
exercise of leadership.' . ' ^ , \ \ 

A corollary to this- obseri>ytion is ^hat to pffer leadership to their 
organizations, Rx managers need, to adopt a prevent i^ orientatipn to 



their potential extei^al problems. To Implement it' effectively will , 
ijecess^.tate the formation of both fonSial and informal sensing and 
infor^i^tioa systems to id^ntify existing or emergent problems, to^gain 
early reactions tp Rx proposals or ideas, and to pr<ovide information .and 
ideas aiout alternate courses of ''action. It also i^ilL require the 
.establishnent of an' Rx mechanism to monitor the "state of. affairs" 
among the organizations in the Nset. Meetings of formal adviS^Dry groups . 
can ie of considerable vl^ue but they ^r^quently *do not yie-ld , complete 
and accurate information.' The reactions of a formal acfidsory group' \ 
and tho^se o.f informal groupings o: of key ind^.viduals in the organiza- 
tionsTd important potentjLal problems may be disparate. By the time a 
problem is iraised in a fo^nal advisory group meeting, it may be too late 
to prevent itsNjccurrencel ' 



A ^cond way -that Rx managers can exhibit leadership in managing the 
exlii(?mal affairs of their organizations is through viewing some of its 
major problems as opportunities for strengthening its inter organizational 
relationships. If a managed of an'^Rx discovers that organizations in 
the set lack knowledge abdut conditions that facilitate and blocic the 
implementation -o^ R&D products, he could -establish a, shortrterm insti- 
tute' that focused on this problem. For example, another opportunity* for 
those who manage Rxs to exeroise leadership is to demonstrate that they 
can offer creative solutions jto RDx interface problems. Rx is in a ' 
double- interface position between* the National Institute of Education* 
on the one hand aTid SEAs and other .organizations in the operating system 
on the other. Rxs must balance federal requirements and constraints 
against the service demands of its cl4.ents. Serving two "masters" can 
lead to many "role conflict problems, but conflict resolution techniques 
may, be ajfailable to resolve some of themj 

A third manner'in which those who manage Rxs can demonstrate. le*adership 
is through utilizing available conceptual schemes t^iat would permit them 
96 exan^ne their organizational problems in a holistic and dynamic way. 
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The notions that interorganizational relationships can be viewed in^ 
dcvelop-er.t.cf ceri3 ar.d that internal operations can materially affect 
an organization's external telations can be extremely heuristic in 
plar.r.ir.s =r.d •'irplerenracion and program development. . f 

A fourir. v=~ zr.az ?z: ::anagers can exercise leadership is through 
concepr^irizi a- Rx, its relationships, its services, its problems 
and those :f rcllaborating organizations, in system terms. This 
orientation fr:;^e3 attention on interrelationships and interdependencies 
and on the varied impact that Rx jictionS may have on other organizations 
in its set. The systemic characteristics of most organizational sets , 
are presentiy inmature. The form they** will take in the future will be 
dependent in large part on the extent to Vhich the;Lr interorganizational 
^ relationships evc^lve- in a« coherent and organized manner or in an un- 
^.planned x^ay, . Because of i&s "global" perspective anT'its focus on dis- 
semination, az Rx has a uniqU© opportunity to contribute to dts organi- . 
zational set- i>nereas SEAs, 'ISAs, and other organizations must devote 
their efforts to a variety of educational activities, an Rx can 
concentrate ±zs resources ^on, system building efforts that maximize the 
•present and potential capabilities of its organizational associates, on 
il^roving^their conceptual and analytical skills, on clai^ifyAg roles, 
definitions ar:d responsibili^ties and on identiiying- gaps and weaknesses 
in prograzna^ic efforts. 



A fifth r:=r.r.ar in which Rx managers can exhibit leadership is through 
both undertaking courses of action tkat reflect their recognition that 
they Dust engage in both organizational and interorganizational develop- 
ment. Since* Rxs a^e parrs ojt labs and centers and thus constitute 
new unit.s within existing organizations, the extent t6 which those who 
. manage an Rx engage in activities that are compatible and 'supportiye 
of other labs and center^ activities will impact on -the organizational 
development of the Rx itself.; The degree to which the Rxs will influence 
the operations of the labs and centers, or their programs will be 
influenced by their host organizations, will be depeodent in part on the 
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^ quality of leadership exhibited by the ^managers of the* Rxs- Rxs can 

also facilitate the organizational deyej:opment of its clients' organi- 
zations. Since dissemination is a relatively new function for many of 

A ' the clients of an Rx, it can offer them'sorely needed technical' assist- 
ance. ' TChather it provides trailing, disseminatipn j>ersonnel or means . 
to develop resources on a i?egional basis, the managers of Rjcs x:an or ^ 
cantiot treat zhese activities as part of systematic efforts to engage 
in organizatiozal and interor^anizational development. If they do, they 
will be maximizing 'the resources at their disposal and reaping the 
cumulative benefits of prograngnatic and linked activities. 

The voluntary nature of the Relationships among the organizations in 
the set will undoubtedly , constitute a major impediment to interorganiza- 
tional development. To the extent thatVSEAs or other client organizations 
or gtoups can refuse to participate in Rx activities, those who manage 
\ them will Jieed to exhibit leadership by providing incentives and by 
finding out basic needs of their potential clients, and by providing 
services that fulfill them. . 

Another leadership challenge emerge^ when an J^ ls viewed in short-run 
a^d^ long-term perspective. It normally will have several short-term 
objectives and is expected to produce services and product^s in response* 
t51:aentified, needs.* However, it also is attempting to maximize 
' the dissemination potentialities of Xts region and this is a long-iTange 
process.. To integrate the two types of objectives is a critical task , 
- confronting ti^ mapagers of.Rxs*^nd will require the exercise of 
.considerable leadership. 



If an Rx is t^o serve as a linking and bridging mechanism among the • 
federal, state and regional levels. It must establish its crediBHity 
and trust and the creation of trust and confidence should be a primary 
J.eadership task of the Rx'^mapager. He and his staff will need to 
demonstrate competency*, openness, empathy, and the ability to work in 
a democratic manner with others. 
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Finally, the exercise of leadership will require that Rx managers 
possess. t':.e ability^ to design tailor-made Rx services and 'products 
for their client /Organizations . ^iven the diversity \^ich characterizes 
the organizations ir.»tae se^,. it is important that each improvement 
effort "i^^l^tcnl.ssd to reSlect^he different needs of 'olie\its and 
'^he V£r^»"-ir.g cir.texzs in wjitch their needs occur. Such tailoring will 
' place h^=~- tecar.cs on personnel and undoubtedly require them to 
concentr^ie *:n a s::;£ll number of their critical ueeds or problems. ^ 

J • , • .V ^ - 

Maying an 1^. rterationaL and offering it leadership are challenging 
undertakings. Tne organizational and interorganizational problems' that 
will arise as a result of this orgariizati^onal ipijiovatipn will likely 
be v^ing and -complex. We liape that the propositions, abservat^ions 
and suggestiqns presented in this paper will alert Rx maa^ers to 
paltential problems the^ may encounter^ provide them with some geniaral 

' guidelines that they may find useful 'in coping with th^, and stimulate 

^ ^' ^ ' ' * 

%tti^ to exercise leadership in the* development of more effective f 

• *■ - 

dissemination systems. 
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I. ^ OVERVIEW. 



1. Background 



The central notion., in the Research and Development Exchange (RDx) 
is interaction; that is, the voluntary interaction of loosely 
affiliated organizations with jsach other, with the educational 
R&D system, and with the context, or environment within which this 
system operates. For pragmatic purposes , these participants will 
be referred to as the: ' 

contractors - comprised of the four National Service Centers CNSCs> 
and the Regional Exchanges (Rxs) ^ ^' 

core stakeholders - which includes NIE, which is the funding 
agency and thereby a major interest holder, and the State ^ 
Educational Agencies (SEAs) affiliated with the Rx in each 
region ^^-^^""^ 

peripheral stakeholders. - these are organizations such as 
the Intertilediate ServiMu-^encies (ISAs), Local Educational 
Agencies (LEAs), ERIC Clearinghouses and commercial producers 
of educational matei;ials 




Each participant associated with RDx performs a wide range of 
specific activities. The outputs from' one activity are often 
needed as inputs to other activities. These activities are inter- 
' dej)endent in that participants could or must interact to pe 
form their own activities. In. order to facilitate th^ pei 
formance of activities and the necessary interactions, soiAe 
form of orchestration is needed* 

The goal of oifchest ration is to provide mechanisms which' allow 
each central RDx participant to integrate its own activities with 

e - 

2U 



4 

each.otlier,^witK*those^ of peripheral participants and with the 

ireeds of the educational system at the local level. The National 

Service Centers and Regional Exchanges will provide a mechanism ' 

f or uch orchestration. NIE's role is primarily in orchestrating 

the bver^l interaction within and development of RDx, and other 

general programs within the educational R&D system. 
* 

Information about activities is needed as an input „to both or-ches*- 
tration ahd decision-making activities within RDx. Information 
is also vital to tlje evaluation of RDx effectiveness and satisfaction 
of all RDx participants. This suggests the^need for including 
within RDx a monitoring process by which such informat;ion can 
be collected and made available to all participants. In this way^ 
RDx can effectively fulfill its dissemination and feedforward 
> functions. ^ 

2. The Monitoring Concept and RDx 

In general, monitoring is a deliberate » aggressive and ongoing 
"information capturing"*^ process concerned with the state of 
internal processes and the external environment of a system or 
organization. Monitoring is purpose-based. Information on 
the state of internal activities provides a basis for establishing 
plans and for coordination^ while information about the external 
environment provides awareness of critical events » factors and 
changing conditions which may affect the organization. 

Monitoring can identify the communication channels which exist 

or are needed, -maintain contacts within the educational R&D system 

and its context and provide information about RDx to^other 

organizations as a basis for establishing contact. " Since RDx 

is a system characterized by voluntaryv^ interactions among loosely 

affiliated otgaiii2:ation8, monitoring becbmes an essential process"" 
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as it facilitates si^cb interaction. In addition to faciliCation 
of intefactic^, monitoring^failjl^ provide inputs to individual 
activities; interaction with the ia)x context ;^ inputs for orches-^ 
tratioh, evaluation research, organisational learning; and tech- 
nical information about various educational innovations. A 

Monitoring is comprised of three basic fi^nctions; collection, 
transmission and linkage. A single organization may collect all 
of the information needed' for its own activities. However, 
given the complexity of most activities,, an organization may 
lack ability to collect adequate informsftion fbr its activities ^ 
(and at times even for a single activity). Therefore, collection 
in. itself becomes a system activity. Once information is collected 
it is necessary to t^^ansfer th^ collected information to those 
who will use it. 'This requires a link both to feed forward the in- 
formation needs of the decision maker and to disseminate collected 

.information to the decision maker. Thus, RDx monitoring will con- 

§ 

tain the collection, linkage and transmission functions, thereby 
providing a wider range of information to each participant than 
each could collect on its own.*^ / 

Monitoring is analogous to the periodic reading of gauges on ' 
dials (i.e. "indicators") which provide descriptive information 
about some critical aspect or cc^hditi,on of a system or its environ- 
ment. An individual indicator reflects thev state or condition of 
some. aspect o^ a more complex system or process. Similarly, a 
set of indicators reflects the overall state or condition of 



♦Naturally, in designing and operating the monitoring process it 
Is critical to take into account the utilization of Vnonitoring 
information. This utilization is not, however, a monitoring fun- 
ction per se . • ^ 
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some conq)lex system or process. In order to increase the use- 
fiOness of information throughout RDx, consideration must be ^ 
given developing comparable indicators and data bases for all 
.participants.^ . • * " ^ x 

In addition to the collection, linkage and transmission of Infor- 
mation, it may be jiecessary to stojre both information that , hap Ji;,^ 
been collected for future use and for future Reference Informiiti^on 
being used in^^rrent activities^. An organizational memory,/ 
which may ^^xlst Independent Qf monitoring, includes records, of 
activities, states and conditions of the system at different pioihts 
in time, as well as qualitative informat'iol^^ch as experiences 
of individuals and analyses based on raw data. / The kinds of 
information required for monitoring and organizational memory, 
then, may be seen to overlap. Thus, monitoring strongly links 
into (and 4an even provide a basis for the establishment and 
operation of) an organizational memory. ^ 



Memory becomes "organizational" only when it can be shared by 
systenr member^; therefore, memory nfust be accessible. Accessing 
invoWes knowledge of the locattion pf inforxnation; ihus a "map" 
of memory is required; The sp/eci^fic storage modear and accessing 
procedures for the memory should reflect the types\ of information, 
the range of members^ and the cost/effectiveness. . for example, 
large amounts of future needs data may be stored in compu^rs, ^, 
microfiche or hard files. Consideration should be given to the * 
number of participants involved and to the cost and effectiveness 
of each mode considered. .5 

Memory also provides ah historicar per8pecti,ve which is essehtial 
in determining bow to Improve or change an organization and in 
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laentifying t/Te constraints and c6nditions to be considered in 
decisionmaking. By monitotipg memory, |Rstofical trends can be 
discerned which may act as a' trigger for .'other monitoring and ^ • 
operational activities.' For examiile* monitpjred iriformatfon mky 
indicate the need to nydify certain relationships w^th the e^viroa- 
ment, or to enter a new'stage^of development. In turn, this .may 
trigger a search for new indicators to provide a.widgr variety . • . 
of information or more detailed information. *Thls.is the basis - 
upon which organizational memory becomes an essential input to 
organizational learning. ' . ■ 

« * 

Organizational* learning denotes the active search for and recogj 
nition-of factors both internal and external 'which may aff^d^ / 
the system. As RDx is a new system operating in a compleK ^onfext , 
organizational learning is critical to RDx. Participants mu^t f . 
develop an awareness of how the whole aty^t^m. operates , their foles 
within RDx and hoW RDx both affects and is affected byUts context. 

RDx can learn why some |ictivities vere or were- not .successful , . 
and thereby which activities to avoid- or repeat ^In the futur^. 
Participants can ^aly^^ relevant experiences an4' sh^re .them so 
tkat others may le^rn from theit experiences. / Siiice memory will 
contain descriptive information on the activities ^of participants , 
memory iriformation must be made available to participants arid 
* participants should place* currtot data, 'interpretations, and 
analyses intQ memory a^ input for an ongoing arganizationa^L 
'learning, process. Thus, organizational learning can be an input 
to RDX decision making, thereby facilitate adaptatioi|vylthin Rd/ 
as well as' adaptation by RDx to its context. 



Further, by identifying the state of RDx development and RDx. 
participants, monitoring will provide a basis for the pro'activenesS 



\ 



of the National Service Centers, For instance. National Service 
Centers can know where communication linkages or integration 
of part±cipant activities are needed. In this manner, monitoring 
contributes to the orchestration of activities by providing for < 
a consistent level of skill development and awareness among 
participants. 

i 

Monitoring provides input to evaluation of RDx for all participants. 
For NIE, in this long term orchestration role, monitoring wotild ^ 
provide information useful in identifying areas of RDx which require 
additional support. Foi^ an SEA, moni toting would provide infor- 
mation to evaluate the degree to which, its affi[iiation with RDx 
provides useful infprmation for its own activities. In Edition, 
each participant can use infor^tion provided by monitoring to 
evaluate factors which have contributed to its own successes and • 
failures, and, therefore, as a basis for establishing future inter- 
actions within RDx to maintain or improve its own performance. 



Since RDx itself is an innovation which is in the process of 
emerging, it. is advantageous to evaltiate it in the spirit of a 
natural quasi-experlment^ The monUtoring proces^ can provide 
valuable information on the different activities and approacljes 
used by participants in performing their RDx- roles. By comparing 
these differences and the dif ferejitial results obtained, RDx can 
develop valuable insights about w^at to fine tune and how to 
dix:ect its, internal processes. As the context of RDx changes, > 
and members gain a better understanding of the context, the 
monitoring process must adapt too. It jnua^ be flexible enough 
to experiment with new indicators and procedurias and ito modify or 
discontinue other3«. Hence, monitof-ing and other RDx processes and 
activities should be appi:oached from such an emergent, experimental 
perspective. 
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3> General Themes of Monitoring 

Some general ooncerns^of monitoring are: - hierarchy, control, need 
for flexibility and need for consistency- We have just noted 
the need for flexibility- 
Consistency is another major concern in monitor ing. The RDx 



monitoring process will provide a wide range of information about 
a wide^range of activities to a wide range of participant^^ In 
order for this information to be useful system-wide, partici- 
pants must be able to understand it. This is to say that the 
indicators and the information ensuing must be comparable or con- 
sistent across all particfLpants . ^ 

t 

It should be emphasized that while in "one sense there is a natural 
hierarchy in RDx (i.e., national, regional and state .organizations) , 
monitoring in RDx is riot hierarchical but multi-directional in 
nature. An ysue related to hierarchy is control. Participants 
will have some control in monitoring to. the extent that their 
activities are associated with monitoring. As its funding agency,^ 
NIE will have a control functi^ over RDx. , However, there will be^ 
no single, "formal" control over the participants in monitoring. 
Therefore, the nature of RDx and the orchestration function require 
different types of t^formation and a different approach to monitoring 
than would a control system. 



Two^ Perspectives on Monitoring 

In keeping with the emergent, experimental nature of RDx, two 
persgeibfives will be discussed as a, base for designing the RDx 
monitoring process. The ad hoc and forma approaches are pre- 
sented as polar design perspectives, with a whole range of 
possibilities In between. 
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Briefly, an ad hoc approachN^rovides for the use of monitoring ^ 
only as infomi^tion becomes needed and would be done only by 
^e participant who needed it. In this sense, each participant, 
wou^d have its own monitoring process, tied loosely if dt all 
to the similarly-specialized nonitoring proces^ses of other 
participan^ts, A formally designed process would cal!^ for highly 
integrated and systematic activities with^prespecified and pre- 
assigned indicators. The information collected would be viewed 
as part of an integrated RDx wide data base. 

it 

In feontrast, it becomes clear that each perspective has distinct < 
advantages and disadvantages which must be considered. For Instance, 
the set rules and integrated nature of the formal approach would 
render the monitoring process slow to grasp changes and even then 
would require 'systematic changes in other monitoring activities^ 
whereas the ad hoc approach may provide the flexibility for 
rapid adaptation. On the other hand, the "every participant for 
himself notion of the ad hoc approach may limit interaction — 
which is a major purpose of RDx — vhlle a formal approach does 
provide for such interaction. Considerations such as the various 
monitoring purposes, time, RDx partiQipant functions and RDx 
philosophy intist also be recognized. In practice, the Conflicting 
needs for fiexibility and division of labor will differ across 
purposes and shift to some degree during each stage' of RDx devel- 
opment.* It is likely., then, that some "middle ground" betwfeen 
ad hoc and formal^ approaches will be needed. > 



5 J The Monitoring Framework 



The many aspects and purpos^s^f the RDx morhLtoring process .will ^ 
make it difficult to design and operate withdut some ptior notion 
of a structure or framework. Rather than approach monitoring in 
terms pf specific activities^ a framework can aggregate the 
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activities by category as well as suggest the range of, inputs 
'required in the design decision, k framework/is necessary regard- 
less of the design perspective (i,e,, ad hoc or formal) • In an 
ad hoc proce3s participants can use, the/framework as a general 
guide or starting point. In a formal/rocess designers may use 
it to- specify how, what and by. whoto monitoring a\:tivlties^ are to 
be 'performed,: The framework serves to identify major issues^ 
and'considerations which should be taken into account in .niakl^ 
tJ^cisions a^out and within the monitoring proc.ess. Specify 
three dimensions are discussed: T^pes of linformation, Titde 
Orientations, axjjj^Location of Activ^i^5^s^ 

In ^es of Informa^tion , a* typology is presented whdfch enables a 
description of the^monitoring process in terms of its principal 
output (informatics) and the varipaa^tpponents of RDx and its 
context • " , , . ^ 

' ' /-^ :^ ' ' " 

The firstf class considered is internal i in-t,t activities information, 

"* . ^ . * ft , 

The identification and .description of each participant's current 

activities ia- the f ocus^ By providing information on what 

activities are being carried out, and how^^ RDx participants 

determine 4hcw these acuities mar affect their ow]j\ This infor- • 

mation also contributes to RDx orchestration by (Tescribing the 

d$,ate of RDx development — in terms of tho-^ivitiefi performed 

W and state of development of participants. Other classes of 

information discussed are: Rv^pmal Unit Activities, Internal 

Unit Results, External Unit Results, and RDx Process l^snformatic/n, 

respectively. Information fn any given class is. related to that 

of other classes/ These class relationships provide a major 

basis fpr locating and relating the diverse activijj^s which ^ 

/comprise RDx monitoring, * ^ 

TC/o basic Time Orientations are'established. Current Needs -infor- 
mation* provides inputs to current activities and is hente generally. 
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transmitted directly to those participants wbo n^^d it, Futtire 

f 

Needs Information will be relevant only in future RDx activities, 
inc lauding evaluation , policymalaffll^ and organizational learning. 
Unlike Current Needs Information, it would be placed in memory 
to be accessed ^d transmitted to users when needed* 

Location of Activities is concerned with identifying which parti- 
cipants will be involved in a given monitdring activity. It is 
crucial to design location • of these activities by specification 
of where information is to ^e collected' and where that information 



is needed. This should be based on a determination .of the classes 
of information needed for current and future activities by parti*- 
cipants, and the types of information readily available to each. 

The final section devoted to the RDx monitoring framework concerns 
the importan. J 'and use of the monitoring "map", p^sented in Table 1. 
The map is a blueprint of the system and can be used to direct devel- 
opment of the monitoring process. RDx can be thought of as having 
four major groups of participants: National Contractors, Regional 
Exchanges, State Educational Agencies and^NIBr* The division is 
based upon the notion^that there is far more homogeneity within these 
groups than across the four groups. This suggests that the nee^^^x 
Information within each group is^ more homogeneous than across tne 
groups. Thus, this grouping provides a useful way to consider the, 
relationships of participants to RDx monitoring in developing a 
framework. 

given class of information may include indicators-' to provide 
information both for current and future ileeds. These indicators 
may be used by organizations in any of the four groups. Each 
cell of the map represents a set of indicators which are identified 
in terms of: the class of information, the information needed and 
the time frame in which the information is to be used. The frame- 
work does not describe what each cell will actually contain. Rather, 
it^^sp^cljfies where specific kinds of information may be cdllected 
and where they may be needed* 
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6. Major Considerations 
f 

ihe above discussion on the monitoring framework provides ways in 
' which to differentiate monitoring activities but does not address 

how to conduct monitoring and other issues concerning the overall' 
monitoring process. By considering such issues as memory, timing, 
incentives and metamonitoring, a more dynamic approach to monitoring 
is tmveiled. . • ' 

Memory 

The importance of memory to the monitoring process ^^s^^ 
suggested in the overlapping bf information needs* The^l 
^ need information of monitoring is stored in memory. "Thus memory 
• , miist be both avaiUble for such use and accessible to participants* 
Memory will also store historical information and will be monitored 
for historical trends. Therefore, organizational memory must be 
developed to facilitate related monitoring needs. 

^ The basic structure of organizational memory is composed of three 

elements. Storage location i^ based upon the memory need^of 
^ and"indica_tors used by participants. This suggests that memory 
do^s not have to reside in one location. It may, in fact, be^ 
'decentralized. Knowledge of contents in the various location^of 
RDx memory can be achieved through the establishment of uniform 
indicators and a "map" of memory. This "map" of memory will be 
necessary even if it is not decentralized. Accessing procedures 
and codes should be spe.cified to provide participants with the' 
ability to access memory across locations and to prevent inappro- 
priate use of memory. These three basic structural elements of 
^ memory will help to provide" an effective RDx monitoring process. 
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Tjiere are trhre/ basic types of memory: active, private and secondary. 
Active memory is open to access by all participants and consists of 
aggregate data needed for participants activities. Private memory 
is located in each participant organization and consists of raw data 
and sensitive information, accessible only by special procedures to 
guarantee confidentiality. Secondary memory includes outdated data 
and raw data which has been interpreted or transferred before being 
stored in active memory. This information is accessible ty special 
permission or procedures at each participant's location. Use of 
these three "types", in addition to usage of consistent indicators 
as noted previously, will aid in the input, mapping, and retrieval 
of information from memory. The emphasis on consistency across 
participants has been addressed in reference to the monitor jj^g pro- 
\ess\nd is thus being ^extended to organizational memory. 




^ "^t — ^ 
Timing . , ffl^en and When not to Monitor 

Timing is a major issue in monitoring. Thus, questions of when^^ 

specific informatioh is needed and under what conditions it should 
be considered as these affect monitoring. Such^factors as cost, 
overlnterpretation, overloads, resentment and inappropriate infor- 
mation will affect timing. Collection of information requires 
the use of resources such as time and money. If information is 
collected too often, resources may be wasted and a greater cost 
-is implied,. If information is collected too frequently there may 
be a tendency t6 overinterpret information by placing inappropriate 
emphasis on minor changes wl^ldlv.may be due to irreleva:Q^t events 
or random errors in the collectionib^lf . Generation of informa- 
tion too often may result in more infotmktlon than can be processed » 
analyzed or used by participants and can also overload the communi-. 
cation network. Thus, BDx participants may resent the time and 
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resources devoted to. monitoring if it is done more often than 
necessary. 

. ■ \ 

The issues* raised above can be Used to suggest several design 
issues in the t^ing of monitoring: the frequency oi^ monitor- 
ing in terms of liow often to monitor, a given indicator; the re- 
levance of information, referring to the collection of more kinds 
of information than required; inefficient or inappropriate use^^N 
of memory, vhich can cause some of the problems mentioned; and 
the staging and phasing of RDx vhich may require different kinds 
of information and indicators at different stages. Indicators 
developed for a specific stage may have to be replaced as the 
stagfes change and information relevant* only to previous stages 
may be purged from memory • These five issues should thus be ' * 
j.ncluded in the design of nynitoring. 

Incentives 

Since RDx Is a voluntary affiliation, strategies should be deviled 
and implemented to help -overcome any barriers to and 'to provide 
incentives for participation. Disincentives to participation may ^ 
include: structural and personnel changes which may be -required, 
cost, evaluation apprehension, and vulnerability of sensitive 
information. For Instance, a participant may not have an established 
organizational memory prior to its association with RDx. The new 
roles and changes in structure, which development of a memory may 
entail, 'can result in resistance to participation in RDx.> 

Therefore, some specific design issues may be cpnsidered. The 
complexity of RDx monitoring (reflected by the number of indicators 
and amount of shared information for example) will affect cost, 
changes and thereby use of ^ the system. Thus there, is a>need to 
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balance complexity and utility in designing the system. RDx may 
want to siipport monitoring activities of participants through 
funds or oth^ resources both to offset resistance due to cost, 
factors and to provide an incentive for participation. Safeguards 
and specific procedures for confidential information, such as 
^aggregation of data and use of outside consultants. Designers 
of RDx should be aware that monitoring can affect power balances 
and participants influence. Participants should be assured of 
equity both in the exchange of information and distributioi^ of 
resources. Finally, the issues which have been raised in this' 
section are necessar/'but not sufficient. This is to say that 
provision of direct incentives should be considered in theVde^sign. 
A proactive approach to creating such incentives may entail the 
marketing of monitoring within RDx and, the establishment of 
norms, culture and commlxment. 

0 

Heta-Monitoring 

Implicit in the foregoing discussions is the suggestion* that 
monitoring be monitored. The complexity of the monitoring process 
and its importance to many RDx purposes (i.e., provision of infor- 
mation to help develop, support and orchestrate RDx) call for a 
"check" on the monitoring process. The puipose of metamonitoring 
is to provide this check. 

SPme criteria by which to evaluate monitoring are thus needed. ' 
The four classes of criteria noted below are based on the monit;oring 
'framework and^ the major considerations. 

1. Information . . ^ • - * . 

" Is information collected when it*s appropriate as opposed to 
just 'for the sake of collecting information? Is Information 

' consistent and then, is it being used? Is there redundancy 
In information, possibly reflecting that linking of participants 



237 



needs is not occuring or that this may be a fault of trans- 
mission (not getting information to those who need it), 
]^:^aps, the information provided is not being used because " 
the time lag between t^e request for and receipt of in- 
formation is too great. ^ 

2, States of Development 

■ / ■ ■ V' 

What progress, if any, has been made in participants cap- 
abilities? Are 'communication channels open RDx-wide? Are 
indicators being added, refined or dropped \flheti appropriate? 
The answers to these questions should provide a good view 
of the state of participation in RDx monitoring. 



3, Design Perspective 

Js the design perspective which was chosen interferiflg with 
the- monitor Ing process? For instance, is an ad hoc system 
fulfilling participants needs for information or is it pro- 
ducing barriers to the exchange of information? Is a for-*, 
mal system underminir^ monitoring by its inflexibility? 
Is a formal syst^^^tfesponsive enough to needs? Hence, there 
will be different criteria necessary depending upon the de- 
sign perspective chosen. However, regardless of the design 
peifepective, criteria are needed for meta -monitoring. 



Memory 

V 



Is memory being filled with future needs information and 
historical records of monitoring? Is Biiemory, being used by 
participants? If not or ifl underutilized, why -r e.g., access 
problems; linkage problems? 
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JiUst as monitoring needsr^ framework, so too does meta-moni- 
to'ring. Three baVic dimension of raeta-monitoring and then 
an overall framework are addressed. 

A major dimension in' meta-raonitoring involves: collection, 
transmission/linkage and memory. Collection is evaluated as to 
what information is input^and, if it is fnput at the correct 
time. Both .the linkage and transmission aspects are reviewed 
in terms of the voltime of information in channels, the state of 
channel development across RDx and the extent to which informa- 
tion is being received by participants who need it* Memory will 
also be scrutinized in meta -monitoring. Specifically, the focus 
will be oni whether or not storage of information from, the 
monitoring process is taking place; to what extent, "oUt -dated" 
data is being purged from memory (i.e., data \Aiich won't be needed 
in the future); whether or not participants have easy access to 
stored information. 

Another dimension concerns which RDx participants are actually 
injp^lved in meta-monitoring. Meta-monitoring can be done by any 
of the four participant groups (that is, NIE, jtfSGa^ Rxs, SEAaJ., 
MetaMnonitoring activities can be differentiated both in terms of 
which of these groups participate in meta-monitoring and those 
aspects of monitoring which they monitor. 

A final dimension concerns the differentiation of meta-monitoring 
activities in terms of which of these groups require meta-moni- 
toring information. 

- • • . , ^ - 

These three dimensions can be 'used t6 construct a frameiJork similar 
to the monitoring framework. Several categories of meta-monitoring 
activity are provided. Based <)n these categories, one can estar 
bHsh-indicators for meta-monitoring. Thfe four classes of criteria 



(discussed above) together with the overall fraioework for moni- 
toring provide an important input to ^his blueRrlnt 'as well. By 
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identifying \diich groups will participate in meta-monitoring 
and who needs the resultant information, a design for the 
meta-monitoring process is provided. 



7. • Operationalization * •> 

The digcussion so far has focused on broad conceptual issues. 
While these are important in providing a basis for addressing, 
designing and operating RDx monitoring, they must be opera- 
tionalized into specific indicataifs7 activities, etc. - 

\ 

The operationalization of RDx monitoring is a broad process 
comprising four major elements. . ' 

1. First is the design of the RDx monitoring process. As 

we have discussed above, this involves the specification 
and assignment of activities to particular participants, 
in accordance with some overall approach to monitoring. 

J - — 

2. ' Another major aspect, is the building of the capabilities 

and mechanisms required Ce.g. , interorganization mechan- 
isms). 



If ' 



3, Tl\<Mmiitoring process must then operate . That is, the 
actu^'col lection and transmission of information will be 



conducted. 



As the process begins to operate, it must be refined, 
corrected and improved. It must also adapt to changes 
or increases in 'its purposes and to change^ in the\RDx 
and context themselves. This is referred to as rectesign . 
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The process for designing RDx monitoring is an ongoing process* 
Afer an initial deafign, building and operational period, the 
changes in the development phaae become inputs, to design. The 
process repeats cyclically with new designs requiring (perhaps) 

• new building and then new activities in the operation of monitor- 

^ng, as represented in. Figure 2. 



Initial 
Design 
. Activities 

V 



Design 
Build ^ 

4 ' 

Operate 



' Changes in: 
-«edesigii^^__^ Conditions, 
. purposes 
In BDx* 



> In discussing litl^^ we will point out decision points and inputs to 
each step. , ^ 

Design * • * ,r > 



The design process is essentially a series of ^ decisions about thfe 
configuration of activities and processes In KDx monitoring* This 
provides a blue, print of the monitoring process which specifies " 
where activities are to be conducted and to where information must 
be transmitted* « \ 

Jhe starting point f br the design process is- the determination o^ the 
purposes \^ich xdlj. b'e served by RDx monitoring. We have discussed 
several' of such purposes, and no doubt others exist. BDx must choose 
from among all possible purposes the ones which monitoring will 
serve. Initially, thi^ list maybe limited. As monitoring emerges 
others can be added or some deleted on the basis of changing needs 
and experience. « 



r 



The, ft^ raiji^€*^8tabli8h the general approach to be taken to 
monitoring *"r , tahere monitoring will lie along, the continuum 
from ad hoc to formal* Based on this one can make decisions about 
which participants will ,^ in g^eral terms, . be involved* in ^onltoring^ 
where memory is to be located (e.g. ; the extent to which it will be 
decentralized^'or centralized) and so on. ' 

We assume that these decisions will be made based on inputs from, 
and .with the participation of, the various participants in RDx;--^ 
The choice of purpose and approach must reflect the nfeeds -and 
interests of RDx as a whole. This is Important to injure that 
monitoring will be as useful as possible. ^ • 

This provides a basis for beginning the Initial 'design of RDx 
monitoring, and is a critical decision point. Only when^purposea 
and approach have been specifically established and agreed upon 
can the actual design be*^ attempted. ^ It must be ^remembereo^-tilat in 
a first attempt to establish these things, 'one need not be ove»rly- 
concerned with final or optimal decision^. , Qne should be as concerned 
with providing ^ basis for a minimal monitoring prpce^s which, once 
' established and operating, can then be added to, /refined, and fu^ly 
emerge over time. 
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.The piU^ss.o.^.movi^ beyond this to an initial design for monitoring 
^s a^matte^of -making ^specific decisions-s^^ut what indicatoj^B will 
be used; what ^rctc4du'res will be followed in collection, linking 
and transmission^ and \kidh'Or*ganization8 in IQDx will perform these. 
Who participates In^ thesP^decisiohs and the level of RD^ In-which they 
are made is ^ func|^ort of tAe approach taken. In an ad hoc process, 
th^ will tend f!p BeMBiadeVty t indlvidueils in .each organization, with- 
out a great deal of input 'Mom othto organizations.* In' a more formal 
approach, these decisions ^ould be made by indivii|uals from several 
organist iohif 
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A set of Indicators must be estabi^^ed at this po±nt as well. The 
number and nature of these must be deVlded on the ba^ls of the pur-, 
pose's served by .monitoring, ^ 

In the more formal process, one will necessarily have to address 
the Issue of the division of monitoring activities and assignment . 
of 'Indicators across those organizations participating In monitor- 
ing, and to Identify w^iere the "Channels over which monitoring 
Information Is to be transmitted will be needed. 

The next decision ^polnt here Is whether the design Is sufficiently 
^coherent and specific for work to begin on building the monitoring 
pICdcess, Criteria for this decision would Include: 

1. sufficient detail to allow building j 

2. ' simple enough to make initial building coiiq)aratlvely 

easy . 

3. flexibility and a sufficient range of orocedures 
to facilitate experimentation and ercrgence 

4. -disincentives such as cost, support, and related issues^ 

have been considered. 



Building 

The design provides a blueprint: the identification of which ofganii 
rations will perform what activities and where information must be 



transmitted. Based on this blueprint the participants In the RBx 

monitoring process can develops the capabilities to perform those 
^onltorlng activities assigned them. RDx, as a whole, can use this 
' to .build the interorganlzatlonal capabilities needed^ for monitoring 

such as information channels, memory and procedures for exchange 

of informatldn. 

A* Staffing/Training 

A major element in building these capabilities is to establish 
the personnel n^eds, establish monitoring roles and staff these 
roles* This must be based on the range of specific skills 
Involved in or related to monitoring. We have lden*tified\£hree 
basic functions in monitoring -(collection, linking, , and \ 
transmission) and two in memory (storage and access) . These 
provide a basis for establishing the specific skills associated 
with the monitoring process. By identifying the -skills needed f 
in any given organization in RDx, that organization can st»ff / 
the positions with- people yho have needed skills and provid^s^^/ 
' training to Improve or provide su5h skills. 

The combination of skills needed by any §lven organization, and 
the way in which these skllfs ar.e combined to establish formal 
organizational roles will be a function of the KDx monitoring 
design. 

V B. Channels 

Another capability which needs to be built is the ability to 
effectively transmit information and to' identify where it is 
needed. Tills requires that communication channels and procedures 
for their use be established. Linking mechanisms will be 
needed to* direct the flow of information. 
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n. Incentives 



We have pointed out abo^e that Incentives are needed to > 
Insure that Information Is collected and transmitted ♦ > In 
building the monitoring process, one must also construct the 
incentives needed to insure its effective operation. We 
argue above that several design factors should be considered 
in the design process. However, one must go beyond this to 
provide more direct incentives. 

These direct incentives involve building a high level of 
commitment to RDx and a recognition of the need to cooperate 
(with respect to monitoring) in order to achieve JftlP^qals^ 
as well as thecals of individual organizations. Thls/^fui 
be achieved essentially by marketing the monitoring process 
to RDx members, ^ 

In ordei;^ for monitoring to be effective, there must be a 
culture established withinywDx which facilitates monitoring. 
This" is partially ^related/to incentives. A climate of trust ^ 
and fcooperatlon must be/established. Individuals mxiat inter- 
nalize noxrms of excha^e of information. 

This culture must also Include norms of experimentation and 
"uncertadLnty seeking." • Members of tox organizations involved- 
in monitoring xBust feel' free to ekperlment and, more Important, 
recognize the importance of seeking alternative ways of 
approaching monitoring. 



D. Support Services 



BDx must also build the support services required to facilitate 
monitoring. Training facilities can te^ provided. Resources 



shouW be developed to support monitoring (e.g.^^,ney, 
temporary personnel^ etc). ' " \^ 



The irrtical decision ^oint here concerns how far- the capabilities ^ 
have been buiit. Before the system can be opeiiat^/one must have 
eatabUshed a minimum level of capability. Criteria for this 
decision would, involve the fit between capabilities and activities 
to be performed in each KDx organization. 

Operation 

9 

When tKe capabilities have been established the monitoring process 
'can begin to operate. Information can be collected and transmitted.^ 
Several issues are relevant to' the operation of RDx-monitoring. 



A critical set of issues concerns timing of coUectlon. Several 
of the' considerations raised above are^elevant- to the operatio^p 
phase. One should address issues of .when and when not to collect 
information about' a given indicator (e^^. : the frequency of 
collection and relevance of a giv^n indicator at different points 
in time) . One shbuld also address issues concerning the use of 
communication channels such as tK^ frequency of transmission and , 
form in which Information is sent. 

Redesign 

As the system operates, it will itself be monitored by the^ meta- ■ 
monitoring process. This meta-monitoring provides information 
oi^ which or^anizationar learning regarding monitoring can occur, i 
This learning will concern the effectivenesf of monitoring process. 
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e.g*: how various approaches, activities, ^tc^have worked. It will 
be based on a comparison of the experiments by various participants, 
~and ^e "results". of these expetlments. This requires that some 
set of criteria exist, such as those we discussed .above (in meta- 
monitoring action) for evaluating both monitoring as a whole and 
for individual activities. ' 

Learning based on regular monitoring information as well as the 
non-monitoring experiences of participants will also occur. Parti- 
cipants win develop an awareness of factors, even|p aad activities 
in BDx or its context wMch should be considered in RDx activities, 
they will become aware of new purposes In addition to tho3e identified 
in thevinitial design process, which could be Served by the inf oration 
collected in the monitoring process. 



xn addition, participants will become aware of changes^ln RDx 
purposes, in the context and in the role of RDx in. the ^ucational 
R&D system. . . 

All three of these provide crucial inputs to redirecting > extending 
and refining the moj^itoring process over time. These inputs provide 



the basis for the development of mo^j^oring: emergence as a fully 
articulated and understood process over time. , 



This learning must be organizational (which here means RDx-wide) 
to be useful. It is only as the sharing of information an3 •exper- 
ience and of interpretations that the awareness and understanding 
of RDx can be translated into systematic changes In RDx "faonitoring. 



Learning based on monitoring information as well as the non-monitoring 
experiences of piarticipants should also occur. Participants will 
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develop an awareness of factors in RDx or its context which sho 
be considered in PDx activities. They will become aware of new 
purposes which could make use of monitoring information (in addition 
to those identified in the initial '^design process). 

Emergence of RDx Monitoring Over Time 

The process we have described here should take place as an ongoing 
cyclical process in \^ich the monitoring process emerges and becomes 
mature. By developing and redesigning' the monitoring process it 
becomes more sophisticated* 

The maturation of the BDk monitoring process should parallel the 
emergence of RDx itself. Bean and Rogers (1977) have pointed out that 
the RDx itself will likely go thrf^urfi several stages maturation* 
Even in the earliest stage of tl^i^^maturation there vrtMr be a \ieed 
for the kind J|fAinf ormation fleeted -in the monitoring process. 
Thus, monitoS^ should be ofperating (although, perhaps at, a rodi- 
mentaify level) in the earliest stage of RDx. As the RDx matures 
over time, the monitoring process must mature as well. ' It must 
develop according to the changihg needs for information within 
RDx at different stages of maturation as well as in response to the 
factorig discussed in the last section. ' 
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II ♦ BACKGROUND 

■ ^ 

1, Uesearch and Development Exchange ^ 

The Research and Development Exchange (RDx) has been conceived 9i 
^as a means to facilitate the dissemination of educational R&D and 
to feed forward to the producers of educational R&D Tjh® needs and 
experiences of the users of educational products* In this coatext, 
RDx provides a linking function (Bean and Rogers 1977), linkinjg 
^ together users and producers (as well as other interested parties) 
by exchanges of information amor\g -several organizations. Thus, 
the central notion in RDx is interaction. 

In the case of RDx, the -interaction is the voluntary interaction 
of loosely affiliated organizations .with each other, with the educa- 
tional R/D&I system, and with the context, or environment, within 
which this system operates (Mojkowski 1977)* The interactions of 
these organizations Involve, primarily, the exchange of information 
about the state of the art in educational R/D&I, the needs of -user?, 
the conditions in the context arid sp on. 

The RDx serves as the major linking role in these Interactions. / . 
The RDx is essentially comprised of the Regional Exchanges O^x) 
and the four National Service Centers • These organizations will be 
referred to as ' Contractors . ; 

In addition, the RDx has a set of wha^ can be^ref erred to as core 
stakeholders ; i.e., organisations .^^ich^are actively involved with 
RDx, which have a major interest in the RDx, /and which (it is 
anticipated) would be represented on Rx advisory or governing boards. 
This group is made up primarily of (1) those State Educational 
Agencies (SEA s) which have become affiliated with the Rx in their 

f ' - ' 
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region and ^2) NIEV though there could at times be other organiza- 
tions included. These organizations and the contractors 
comprise the central parties to the RDx. ^ • , 

The RDx, operating^'through thesa central parties', pro.vides a basis 
for extending conmnitlication linkages to what .may be called peripheral 
stakeholders — organizations which have an interest in ot ar^ of 
Interest for the activities of RDx — though less directly so than 
in the case of the central pkrties* These would include commercia 
producers of educational materials > educational associations, educa- 
tional R&D laboratories or centers, universities i the ERIC dear 
'houses, Intermediate Service Agencies and Local Educational Agenc 
(ISAs and LEAs), and other programs for dissemination or feedforward 
such as the National Diffusion Networ)c or the State Diffusion Grants 
Program. ^ ^ 

2. Special Aspects of RDx Operation 

A* Operation of RDx 

The organizations which are associated with RDx each perform 
a range of specific activities which comprise RDx processes. 
There is adivision of labor among these organizations which 
results in different organizations, or groups of organizations 
performing different activities. 

These activities aire highly interdependent. That is, the outputs 
from one activity are of teif needed as an Input to other activities. 
These interdeperidencies within RDx are often quite complex. 
The outputs from several activities may be required before 
^certain other activities can be performed. In some cases, outputs 
I from one activity may become inputs to another, which in turn pro- 
duce outcomes needed as inputs to the original activity. 



The coB^^lexLty is increased by the fact that 

Interdependent activities may be "performed in different .organi- 
zations. Thus, interdependencies Will exist among organiza- 
tions, as well as among activities. This requires that the 
organizations associated with RDxCwhether they are core parti- 
cipants, cdre stakeholders or peripheral stakeholders), must 
interact to perform their own activities. 



B. Orchestration - * • 

In orcje?: to facilitate th^ performance of activities and the 
necessary interactions among organizations associated with RDx, 
some form of orchestration is needed. By orchestration is- 
meant supporting activities where needed, identifying potential 
problems or weaknesses in t;he RDx, and providing a means to 
strengthen such weaknesses that occur. , 

The goal of orchestration is to integ^a^e the activities of the 
central parties to RDx with eath other, with those of more 
peripheral organizations and with the needs of the educational 
system at the local level. More accurately, it is to provide 
mechanisms , to allow each central RDx organization to integrate 
its own activities with those of other organizations. .In this 

*way, RDx can effectively fulfill its dissemination an4 feed 

' forward functions. * 

These orchestration roles are to be formally provided by NIE 
. and \e National Service Centers. NIE's role' is primarily in ^ 
orchestrating the overall relationship between RDx and other 
general programs within the educational R/D&I system. The [ 
National Service Centers will be involved In tHe'orcfiestration 
of the more specific relationships among organizations associated 
with RDx, and other organizations in the R/D&I system. 
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C, Mediation 
** , ' ' 

RDx Is in a vulnerable position with respect to the relatlcgiships 

9 

with the core stakeholders. NIE will eventually decide the 
^ degree to which RDx will contiuue to operate. The SEA s will 
eventually decide the degree to which they* will become or sremain 
associated with RDx. 

•These organizations each have the ability to reduce the effective- 
ness of the RDx. The contractors must mediate ^he tensions 
which can pull the RDx apart. Such tensions can restdt from the 
different g6als of the drganizations associated with. the RI?x and 
from different evaluations of the usefulness of RDx iox their 
own specific activities. • * \ 

D. Need for Information * , - ' 

• • « ' • 

Each of these aspects of the operation of RDx requires that 
Informatiori be* provided which can "be used^ in orchestrating RDx 
activities, and in evaluating the effectiveness of RDx. It also 
. requires that the contractors ^a^e information concerning 

stakeholder' satisfaction with RDx in order to identify where there 
is a danger of stakeholders disassociating themselves ^rom RDx. 



3. Ckmceptual Overview of Monitoring 

In addition- to information about the specific characteristics of 
innovations or user needs, the effective operation of any system 
requires that information be generated and exchanged concerning 
.the system itself, the activities performed in the system, and its 
environment. This suggests tlfe need for including within the* system 
a monitoring process by which such Inf drmation can be collected and 
made available to decision makers in different locations withitt^t^e . 
syst^. 
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A> Monitoring Defined 

In general, monitoring can be understood as the systematic and 
ongoing collection and transmission of information, useful for * . 
operational or policy decision making, which provides a des- 

^cription or overview of conditions, states or activities in \he 

.system or its environment. ^ 

'Monitoring is a general process, characteristic of organizations 
or systems which must maintain and integrate internal processes 
and which interact with their environments. Aguilar (1367). has 
pointed out that effective organizations regularly collect infor- 
mation about their environments in order to provide information 
aboi^t critical events or factors which may affect the organisation 
and to b§ aware of changing conditions in the environment. Emery 
(1969) has suggested that a similar prociess is 'needed concerning 
the' state of internal activities to provide a basis for establishing 
plans and for coordination. 

Hbnitorlng, then, is a deliberate, agressive and ongoii/g process 
for collecting and transmitting Information about ti\e state of 
.internal processes and the external environment of some system 
or organization ~ 'information wh^ch is critical f of maintenance 
Of the system's (or organization's) operations (Ashby I960).' 
Hatcher (1976) has characterized this collection of information 
as "Information capturing". * . ' - 

B* Basic Roles in Monitoring .' . ^ 

In addressing the monitoring process it is important to be^^swh^re 
that, %n general, information us^ not be collected by the de- 
cision makers who use it. The conduct of monitoring by specific 
individuals or units in an organization of system makes it 
possible to specialize the skills needed. and to free* decision 
makers froi? a time consuming activity. In other words, the 
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division of Iftbor between monitoring roles and decision making . 
roles is advantagious. This divisioti of labor suggests that 
two basic activities must be included in the monitoring process. 
First, information must be collected . Then it must be trans- . 
mitted to those decision makers who require it for their own 
activities. • 

Since monitoring w^ill produce a wide range of information that 
serves many different needs, not all information will be useful 
or relevant to all decision makers. -Thus, any given, piece of 
information must be linked with those decision makers who need 
'it. ' This linking can be thought of as a switch board which 
identifiers where a given piece of information is to be trans- 
mitted. 

0 * 

Another consideration here is that information collected through 
monitoring is not necessarily usri^d immefdiately. Some infor- 
mation may be needed only in the future for subsequent evalua- 
tions or historical overviews of the' system 6r organization, y 
Other information may be neede^ both in the futt^e and at the 
time it is collected. This future need for collected informa- 
tion requires that the information be stored iij some manner. 
Tho^e pieces of information, to be stored musty be identified, 
linked with and transmitted to someone wh^wlll store the infor- 
mation. This storage may be done directly by those people 
conduct ing^tihe monitoring process or in soiae other* part of 
. the organization or system (in which case it becomes only a 
special case of -linking and £ransmission\ are involved. Natu- 
rally, if monitoring information is storid for future tjfies, it 
must also be accessed ' at some time. The access of stored moni- 
toripg' information is also a basic monitoi^ing activity. 
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Indicators 



Monitoring is analogous to the perlQdlc reading of guages or 
dials (e.g.: a thermojneter; a:^ automobile gas guage or an airplane 
altimeterj a, humidity guage) which provide descriptive infor- 
mation a|)out some critical aspect or condition of a system *or 
its environment. The "readings"' are indicators — indicators 
vhich indirectly reflect some state or condition* An individual 
indicator reflects the state or condition of an aspect of a mote 
complex system or process. Taken together, a set of indicators 
reflects the overall state or condition of some copplex system 
or process. 

4 

Indicators, then, are specific, identifiable and measurable 
factors which refle<^ critical aspects of some process. 

L * ' 

It is neither necessary nor efficient to have or use all 

possible indicators. A wide range of possible information ^ 

can be provided by indicators which could describe such 

complex processes or systems. Howevef , not all information f 

of this type is relevant. In some cases, different indicators 

would provide redundant information (which is notneQessaifily a 

•*bad" thing). In other cases, it may not be possible (for. 

whatever reason) to establish an indicator. 

The indicators actually used in monitoring are only a limited 
set of all possible indicators. "Thus, it is criticar to 
recognize that* the choice of thoflle indicatoi^s used in any 
monitoring process must be based oa an understanding, or 
estimate, of the specific aspects of the phenomena being 
monitored which are most relevant. This rielevance is deter- 
mined by the decieipns to which monitored information will be 
an input. Other fjactdrs such^as cost/effectiveness, aVaila- \ 
billty and accessibility will also affect the choice of 
Indicators. ' • , . 
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4. Sbme General Purposes of Monitoring • ' " 

. \ T^. ' . ..• 

Monitoring Jfi a purposefu^^ctivity. At a generafl. level, we ' 
have already noted that theVrerall purpose of monitoring "is 
to provide decision makers (and analysts) with a^ackgtound 
overview of a system or sector. There are> some other purposes 
of monitoring which are worth noting here. , 

' • A. Trl^ering ^ . - , 

One major purpose of monitoring ' is the "triggering" of ^ 
specific operational activities. For example/the in- 
formation provided by monitoring c«i indicate .that fhe 
systgm should now initiate a new production process, " 
""change the level of .Its output, modify the nature of rlts 
^relationships with its envii^onment, modify some? internal 

* system activity, enter a new stage of development, .and 
so on. ^ ' . 

This, triggering may be the result of pre-established threshblds 

which specify that under a giveit set of conditions ^or at a 

1 ^ * 

given point •in a process certain spefcified operational activities 
are performed or new activities are initiated. It may also be^ 
the case that a- decision maker may 'find a significant pattern or 
tretid^n the information provided by several indicators which 
indicates that new activities are needed, even thou*gh no.8pec;.fic 
threshold has been established. 

^his triggering can result in the initiation of addit^-onal 
monitoring activities as well. These may be pre-established. 
Under a given set of conditions the monitoring process is 
directed to use other^dica^rors which proVide more detailed 
information about some specific aspect of the 'system or its 

* environment. On the otiher hand, the information available may 
lead to a petception of. the nee? for new monitoring activities. 
That is, that given the set of conditions which now exist. 
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information is ^needed for which indicators have not been 
established, or are not readily available. This will trigger 
a search for indicai:ors to provide di^erent or more* detailed 
information which can be used as input to a current problem, or 
to be establCehed as part of-an ongoing monitoring process. 



B, M^norv 

' . . ^ • . / 

A second major purpose of monitoring is to provide a basis for the 
, establishment and operation of an organizational memory v* An organi- 
zational memory includes information which has been stored in some 
^ form which records past and current activities and the* states and 
^conditions of the system at different points in tim«. . In addition, 

4 ^ 

organizational memory includes a great deal of qualitative Information: 
the interpretations and analyses of raw data or of past or current ex- 
periences or activities vJhich have been prepared by organizational 
members, or by individuals from outside of the organization. ^ 

A fundamental aspect of ^ memory is the storage of such information. 
* It is. important to recognize that a wide range' of storage modes are 
possible. While some information can be stored in the form of 
, ' computerized records, the more qualitive kinds of information may 
be more appropriately store^d in reports or other documents, ljuch 
^of this qualitive information will exist in^theT individual 
memories of oManizational members. '' ' 



Memory is- not simply a matter of the storage of information. 
TherQ must exist a se|: of procedures by whicH information caA 
bd accessed . Memory becomes organizational only wften it can be 
shared by organizational members. ^ThUs requires two basic 



,*0f course, monitoring Is not the only basis for the establishment^ 
and operation of organiz'ational^ memories • . , 
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activities: the locating of where information exists and the- 
transfer of information from that location to another. Different 
V storage modes will require different accessing procedures. 

Accessing also requires that there exists a 'Hnap" of memory: a 
summarx, statement of where specific kinds of information is ^ 
stored, and the procedures by which that, information can be 
» • accessed. The range of types of information stored in- memory 
and the range ^ of RDx-central and. peripheral participants require^ 
consideration of a wide range pf storage modes and accessing, 
procedures. No single storage mode or accessing procedure is^ 
likely to be effective and/ or cost/effective in all instances. 

While it is important to note that memory to a large 'extent involves 
the storage of information produced by monitoring, and that^ such 
information is a critical input to other types of information in 
memory, the more qualitive information cannot be produced by 
monitoring alone. Analyses and interpretations, as well 
as the specific experience^ of individuals are critical to the 
development and use of organizational memory, prganizational' . - 
memory provides an input to decision making and problem solving 
within the organization. It makes available information about 
courses of action which have been taken, the conditions that 
existed at the time, outcomes of these actions as well as some' 
ari^lyses of why specific results were-^or were not obtained.' 
As> March and Simon (1958) have pointed out information of this 
type is a major input to human problem solvi-ng^^iaemory also provides 
a basis for the development of an understan^ng of the underlying 
historical processes which have, over time, contributed to th^ 
current state of the system. Mquzelis (1967) has argued that such 
processes are critical in> understanding how ah organization (or 
system) Currently operates. This historical perspective is 
essential in determining how to improve or change an organization,^ , 
and in identifying the constraints and conditions which should be 
considered in decisiorf making* Thus memory is an essential input 

^ \ 
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to organizational learning whi<:h we will discuss below. Finally, 
it should be pointed out that memory itself is monitored. By 
monitoring melttory, historical trends or patl^rns .can be discerned 
which can act as a ti^gger for other monitoring activities, 

C, Organizational Learning ' , ^ 

'Closely related ,to memoasy; is the process of organizational ^ 
learning. Duncan and Wei^s (in prese^ ) haVe described organiza- 
tdcfKai/learning as the process by which members of the organi- 
zation develop an awareness or understanding ^of the organization 

4 and its environment, including previous organizational activities 
which have or J>ave not lead to desired results un^er a given set 

%i of conditions. Organizational ^learning thus limits the "reinverttion 
of the wheel", and by providing an underst^njiy|g of the nature of 
. the organization'ss^activi'tietf, helps decisi^^M^ts choose 
those activities ^or policies which are mtf^^BK^ly to lead . 
to success. . ' - - 



A critical factor in organizational learning is that individuals 
within the system must have access to a brogd range of information 
(both current monitored information and inf ormation ^ffora memory) 
^ iSiiich they did not collect and. which may well extend beyond 
•their own domain. ' 

5. Purposes of Monitoring in RIbc / 

I 

As discussed above, monitoring is not specific to RD»! it is a 
'^-process that characterizes organizations and systems £it general. 
In developing a set of ideas aboyt monitoring for the RDk 
specifically, however, it is important to consider how "the general 
issue^ concerning monitor'ing relate to monitoring within RDx . • 
and to monitoring issues that aVise because of the nature of 
RDX itself. • ^ • 



259 



In this section, several specific RDx - related purposes of. . 
monitoi|^ng are suggested, and the relationship of monitoring to 
other RDx functions is dis.cussed. 

• . - ^\ y 

. A> Facilitation of Interaction , ^ ^ 

: I 

A central purpose of .morilbtoring is to facilitate thf interactiicm ^ 
of participating organizations and the exchange of information 
' among these organizations. vFor example, monftori^^ carl provide 
information, to participants about • the activities of other 
organizations which may' be relevant to their own activities, ^ 
This infopnation can be ua^ul in d^3^c^t4ri| a participant to 
ot^er organizations with which interaction may be beneficial. 
Monitoring can also identify the communication channels which / * 
exist; or are needed, and^wh^h cart b^ used by riiember organiza- ^ 
tionsl Such facilitation is especially important in systems 
' such as Rfix which are characterized by voluntary. inter&tions 
among loosely affiliated organiza tioris. ^ • 

B* • Inputs to Individual- Activities • . 

, ' ^ > . * 

Monitorir^§^is also important for the individual activities of 
. a participating organization of RDx. It can provide information 
which triggers specific activiti6s, indicates that cer^'in ^ >^ 
activities are now appropriate to engage in, that/,more information 
about some aspect of RDx 03^ its own organization is nee4ed, etc. 

C. Interaction with RDx Context 

RDx monitoring provides an important input into^int^aining'- 
contacts with other organizations in the educational R/D&I^ 

tem and in the Iti^ educational context; -By proviA:^ " * 
iri^ormation .abou^ the conditions or activities outside of RDx, 
-Monitoring helps RDx participShts to Identify organizations with 
which more direct interaction will be 'useful. Such organization3\ 
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can be^lmportant sources of more detailed informatlon'-fkii^ut educa- ^ 
tional innpvations or user needs, information which 'should be in- 
cluded as inputs to the RDx cbLs semination and feed forward functions. 
In this way RDx can begin to extend its contacts x^th.its context 
and expand the range of sources of Inputs tio RDx activities/ 

In addition, the process cati be reversed. Monitoring can provide 
information ^bout the RDx to other organizations in the educational 
R/D&I system and in the larger educational pontext who have_ an 
interest in the RDx. This can ^provide a basis for such organizations 
to. initiate contact with RDx and to begin to establish linkages 
between their activities and those of RDx. 

D> Orchestration ^ " ^ 

RDx monitoring provides an Important input to the orchestration 

of the RDx. By^ proviiiing information to the National Service 

Centers about the conditions and states of development of RDx, ^ 

monitoring will be useful in -indicating those , aspects of the 

RDx which require additional support. It will also be useful 

in helping the National Service Centers provide- direct ion to . 

RX and SEAs for building cpmraunication linkages amSng themselves 

and in integrating' their activities. , ^ ' . 

By providing information on the states, conditions and activities 

^* ^ 
of member organizations, th^ monitoring 'process will also provide the 

National Service Centers with a basis for 'identifying those 

participants who Mght hav4 use for information known to be held o- 

by, another participant. Thus, the National Service^Centers carf 

be more^proactive in their service roles, searching out where 

their services can be useful (iil^where participants ^^nay not be 

aware that their Sjer vices .are available.^ By doing this, tljey 

can contribute to the orchestration of the activities within'' 

RDx by/f)rovi^ng a more consistent level of the development of 

skills within the participant , organisations and of the awareness 

by participating organizations of the services available. ^ 

■ . ■. , 261 
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^RDx monitoring will be a useful input to NIE in its more general, 
long term orchesti*ation role. Monitoring can serve as a bas»is 
for evaluating the effectiveness of RDx and in identifying 
those areas of -RDx which r§cfuire modification or additional 
support. Such information will also be useful in making decisions 
about ejctending the scope- of RDx", and in creating other similar 
systems for related purposes. The information generated by 
monitoring can be an input into the- design of such systems, 

#• » 
Monitoring {>rovides an important input t-^ orchestration on a> 
more informal level. SEAs, as well as peripheral stakeholders, 
must make decisions about the degree to which they Wll interact 
with RDx orgatvizations, the nature of their inter^tioa and the 
overall level of their involvement with RDx. Information 
provided by the monitoring process allows such organizations to 
establish which othei;. organizations can provide useful inputs 

'to its own activities. Such information also allows each ^ 
organization to evaluate (over/time) the degree to which inter- 
actions with specific organizati^ons and the association: with • 
RDx in general provide useful inputs to its own activities. 

Monitoring also can provide an inP^t to eaeh orgah^atioA 
associated with RDx for i^s evaluations of itself. The 
organization can use this information to establish the 
factors which have contributed to\ts own successes or 
failures' and to provide a basis for establishing future ^ 
' int^ra^^tions w:|^thin RDX to maintain or improve *its own 
performance. y,, % ^ 

RDX laopitoring provides a widen' r^nge of'infotmation to each 



ianization' than it coulA-collect on ifcs own. Infortaatioo^ 
ecodfe^ available about tMactivities of the RDx as a whol^, 
about other specific organizations, and about conditions .in * ^ 
the educational context. Tntis, l^e increased range of facto^fs 
about; which information is^ avallabld.allows eaqh organization . 
to make more realistic evaluations aid decisions. * ' /^ 



• '26^.. ,, ■ X 
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E, Evaluation Resear^ , 

A. related function of RDX mouitoring concerns its use in 
evaluation research, both on RDX itself and on educational 
innovations carried out by .educational institutions directly 
or indirectly associated with RDX. 

Radnor, Hofler; & Rich (1977) have pointed out \hat R&c is itself an 
innovation which is in the process of emerging and that it is 
advantageous to approach it ip the spirit -&f a natural 
quasi-experiment. The different parties within RDx are likely 
to engage in different activities and use different approaches 
in perfopning thei# RDx roles. By comparing these differences, ' 
and .the' differential results obtained, RDx^an develop 
valuable insights in how to direct and frne'^^femie its internal 
processes. The monitoring process can ^provide valuable in- 
formation about the naturjfe of such-activities and the cj»Kii- 
.tions under' which they lead to different results. S^ilarly, 
monitoring as^ well as other kOx processes and activities should 
• be approached from such an emergeni ' experimental perspective. 

T /Ik ' * 

Similarly, RDx monitoHng *can provide information important in the 
evaluation of specific educational innovations; ^ i.e. , information 
'about 1 ) the^ conditions under which they have been in^lemented; 

2) the results of their use; and 3)' the effects of RDx activities 
(e.g.:* need identification) ^n the success «of such inaovations* 

' ^K. Organizational Learning 

t ^ . ' » \ ' 

Organizational learning is critical 'for RDx. "RDx is a new program 
" ■ ' ^ ♦ - i « ft 

operating in a complex context and performing Ill-understood , . 

activities. 5h«s, RDx participants must begin to learn hdw ;best to 

"^perAte within the' RDx ^nd hpw RDx operates as a whole. 

This requires' aYi understanding 6i the effects of the con^lex 

intetaction patferns among the parties in RDx and between RDx and . 



W ^ peripheral stakeholders. RDx members must learn liow RDx is affected 

and cDtiaftrained by'its context and how. RDx affects the context. 
^ - Thqy must begin to develop an awareness of ^;Ke~ways in which RDx 

can aid their own activities. I ^ 

. , ■ , ■ ; /. 

This learning requires that infonlation aWout a wide range ,odP 
, RDx activiti^, contextual conditipns and, the state of RDx be 
available tui members of the or^nizations con^r^siti^ or asso- 
ciated with RDx.' This includes both* current information, and 
. historical information from organizational memory. Of course, 

I iferely providing such" information does not insure that organi- 

' zational learning takes place, but this is a necessary condition. 
Monitoring is 'a major source of such information. 

Organizational memory will play a crucial role in organizational 
^ * learning within the RDx. By providing a record of past activities, . 
the conditions under \^hich they were carried out (both internal 
and external to RDx) and the results of these activities, indi- 
viduals In* participant organizations cap learn from the past 
experience of- others. This is facilitated by including in ^ 
memory previous interpretations of these data and explanations of 
out'comes. This process requires that information already 
in memory be made available to those individuals who meed it — 
and that they, in turn, place current data, interppfit^tions 
and analyses into memory, as inputs for an on^fng organization- 
al learning process^ 



G. Organizational Memory 

Memory server other functions in the RDx as well. It provides 
(a source of technical information about various educational 
itoiovations , which can searched in response to a request 
for information by an RDx participant or other educationafl 
institution. Memory can be used to store information about 
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the activities of RD2j participants which is useful in esta- 
^^li^ing contacts and linkages within the RDx; Finally, 

memory will provide an historical record of RDx which will be 
essential in evaluating RDx and making policy decisions re- 
garding its development, 

H. Relationship^ of Monitoring to Other RDx Funct;ion3 - 

It is possible that the purposes of monitoring in RDx dis- 
cussed here will overlap with other RDx functions at cer- 
tain times. However, it is important to remember that mon- 
itoring is concerned only with providing information that 
provides an overview description of activities, conditions 
^ or outcomes, and not with the collection of detailed infer- 
mation about specific cases. < 

For example, RDx monitoring should %e concerned wfth the need 
identification ptocess (a central RDx function). Monitoring 
is not the process by which need identification is donl and 
would not specify how need identificat^ion inf.ormation is to be \^ 
collected. Rather, the monitoring process would be concerned . 
with certain indicators about need idettif ication; e.g.: when 
or if need identification was performed, who d^d it, and 
certain aspects of the results. \ 

The same holds for other "RDx functions, sUch as information \ 
synthesis (cf. Rich, 1977) or information transfer 'across 
communicaticJn channels (cf. Mojkowski, 1977). Monitoring is 
concerned with the "collection and storage of information to 
describe such processes and with providing such ^scrlptive 
information to those who need it — not with on-line Woceasing 
of infonaation 4bout specific ia)x actiV^iea. 
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& General Themes and Issues . 

In approaching monitoring within the context of the RDx, we have 

focused on several general themes and issues which form the hasXs 

for our discussion. These are specifically related to RDx, and 

extend tlie discussion of RDx monitoring beyond the purposes of 

» 

motlitoring in RDx discussed above. ^ 
A. Moniiiofing and Control 

Many discussions of monitoring are based on the assumption 
that the information collected will be used for the formal 
control of those being monitored (cf. Rappoport, 1970). 
>-^JkJ{?ever, since RDx itself has no such direct control func- 
/ tion, the nature of RDx and the orchestration function 
/ within .it require a different approach \to monitoring and 

different types of information than would ^ control system. 
(We may not!?, however, that as the funding agency; NIE/does 
have a control function in relation to RI«c. Also, th^ core 
stakeholders have a control function via th^^oluntary 
nature of their pfi^i'cipation) . 

' B> Muiti-directional, Non-hierarchical Monitoring > 

Monitoring processes are generally considered hierarchical ^ 
in that each level of some system monitors the . level below' it. 
(cf. Emery 1969). While there is a natural hieray:hy in RDx 
(made up of NIE and national, regional and state organizations) , 
monitoring in' RDx i^. essentially multi-directional rathet 

than hierarchical in nature. The information needs 
• y ' - * . • * 

of RDx require? that each participant monitor organizations 

If « ^ 

at ^ach'levii. It 'is from such a multi-di'reatiortal ^perspec- 
tive that we will lateif discuss such questions as which RDx ' 
participants monitor <iifferent aspects of the RDx and its context 
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RDx operates in a con^lex, dynamic environment (or context). 
Since the range of possible impacts of the context on RDx 
is so large, it -is difficult to specify (without a great deal, 
of uncertainty) what actiyiti^es will lead to desired results. 
Burns and Stalker (1961) have atgued that organizations 
operating in such environments Require a high degree of 
flexibility in thei^ internal operations*. 

This applies to RDx monitoring. As the context of the RDx 
changes, and as RDx members gain a better understanding of the 
context, the monitoring process must adapt. AlreMy-establi6hed 
^ndic ators and procedure^* may have to be i^odif ied or even 
discontinued. New indicators may have' to be identified and new 
procedures for collecting information instituted.. Furthermore, 
the monitoring process itself must experiment, with possible 
new indicators and procedures to provide a basis for learning. 
All of this requires thifctox monitoring be flexible. " 

D. Need for Consistency 

Monitoring provides a wide range of information about a wide 
range o-f activities to a wTd6 range of RDx participants. 
If this information is to be useful, it must be comparable. 
That. is», the information at a given point in time on a given 
indicator must be comparable to the information col^cted' 
on that indicator at different times. Similarly, when' 
s<^veral^ different RDx participants (e.g.; several Regional 
Exchanges) are separately monitoring the same phenomenon, * 
t^e information they collect must "be comparable. This will 
be an especially important pracpical issue if the dijEferent 

cat 

M 



participants use different indicators. Furthermore, the 
information must be collected ana presented in a way w^ch 
is understandable to RDx participants in orgahiz^tions other 
thv fhe one that Collected it. 
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7> Approaches to a Monitoring Framework 



In discussing a conceptual framework for monitoring within the RDx, 

it is important to consider the range of perspectives ^that might be 

used in the design of RDx monitoring and to identify the role of a^ 

framewoiit- within those perspectives. This section discusses two 

•perspectives and suggests- how^a conceptual Tramework for -RDx 

monitoring is related to both. ^ These two perspectives may be seen 

as two ends of a design continuum, with various combinations of the 

# 

two perspectives representing a wide range of options available for 
different purposes and cbnditions oyer ti'me. Thus, the conceptual 
framework suggested here allows experimentation and "emergence" 
while providing a conceptual design "anchor" or reference point. 



A. Two Approaches to Mohltoring 



The range of ap^proaches to monitoricig in the RDx can be se^m 
as & continuum ranging from monitoiring as a group of (gener- 
ally unconnected) ad hoc activities to a formalized , system- 
atic, integrated process. For purposes of analysis, we will 
here compare these two' polar approaches, ad hoc and- formal. 



Throu^ an ad hoc approach, RDx monitoring would be carried 
out as informatioti becomes needed and would be done by that 
participant: who needed, the information. Each RDx participant ' 
would use those indicators 'which are relevant to that parti- 
cipant's particular needs. Thus, each participant would have 
its own monitoring process^ tied«only loosely (if at all) to 
> the similarly-specialized monitoring processes of other or- 
ganizations. Each organization would have a great deal of 
discretion in establishing the indicators and the procedures 
used to collect, store and trausmit information in its own , 
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monitoring process. 
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^ formally designed process, TlDx monitoring would be carried 
out in tetms of a highly integrated, systematic set of activi- 
ties. Indicators Would be used which are prespecified and 
specifically assigned to participants/ Formal procedures would 
^ established to determi^ how information is to be collected, 

•stored^ and transmitted. formally designed monitori^ could 
^ be either centralized or decentralized. In either case, re- * 
levant linkages would be specified. The infdcm^tion collected 
would be viewed as becoming part of an intesftated RDx-wide - . 
data base. 



B. Coi 


Qparison of j 


che Approached 









_Xn considering these two polar approaches, it becomes clear 
that each .has distinct advantages and disadvantages. The ad hoc 
approach provides for flexibility and adaptation. Monitoring 
activities can be quickly changed to meet changing needs and 

, conditions. Given the instalTility and coiiq)lexity of-RDx 
and the context within which it operates, this could be advan- 
tageous.^ By contrast, the formal approach, with its foxnnal 
rules and integrated design, would not be capable of rapid 
change since any change made in monitoring activities would 
require systematic changes in other monitoringi activities. 

The ^ad hoc approach aLiows for experimenting with new mnitoring 
procedures'^ fcherebv/Tacilitating organizational learning with 
regard to monitoirtng. An ad hoc monitoring process allowi 

"~pareicl^ants~tirre-whatrMteha 



embracing' --chat ^is, to identify where- prpblems exist and to 
take action to correct these problems. By providing a 
. formalized set of procedures, the formal approach poses ^ 
serious constrainfb to such organizational leamiri^ (Duncan 
^d Wgiss, in press;. However, the formal approach i?ould 
provide more systematic information about RDx as a whole 
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infoximation which can thus provide a basis for more general, 
RDx-wide organizational learning. While under an ad hoc 
approach, learning is likely to be more rapid. It would 
tend to be "parochial" both in content (i»e», li\nited to 
local issues and by the capabilities of local personnel) 
and in scope of use (i.e.,, by a. particular participant 
' except as mechanisms exist for participants to "talk with 
. .each other"). 

The ad hoc approach can also lhad to a more efficient use. of 
resources, since time and effort is expended only information 
is needed, and 'only to collect, such information as is needed. 
Under the 'formal approach, there is a greater likelihood that 
information will be collected which is hot specifically relevant 
to, any given participant or to the RDx at a given point in time. 

The formal approach provides for more consisftent informa- 
tion over time ^nd across the organizations associated-' with 
RDx. Thus with a more systematic monitoring process^ a 
given organization in, RDx would be better able to take ad- 
vantage of information collected by other parties. The ad*" 
lioc approach can result .in idiosryncratic information which 
limits the overall usefulness of mpnitoring* Furthermore, 
an ad hoc approach may limit the usefulness, of organization-- 
al memory: information at one point in time may not be com* 
parable to information at another; information collected by 
one organization may not be comparable with information col* 
lected oa the same subject by other organizations; andica* 
^tors and procedures for collection of information will likely 
vary^, — '^rx-juicliJtjinn^-^i^^ii'iA bft dtf f tcult_,ta_evejgL-b. e aware 
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of yj^t information is available in- an RDx organizational 
'memory since the ^torage of inforinatipn would not»be sys- 
tematic. ^ ' ( 

The ad hoc approach would tend to provide less ijnformatlon 
which is useful for the 6rchestratioA of RDx. For orches- 
tration pui^poses, mphitoring information must be comparable 
so as to allow comparisons ^bout .states o£ 

• • ' : 270 ' 
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development ; about different participants and their acti- 
vities; about the need for linkages among participants.' An 
'integrated baffe-.^^ information is necessary for the eval- 
uation of the. states of development ^of RDx as a yho'le, as 
well, and to determine the overall effectiveness of RDx. 
Thus, the more formal approach provides a more useful in- / 
. p ut to the orchestration activities of both the National 
Service Centers* and NIE. 

It should also be pointed tut that it may not be possible for 
any given organization involved in RDx to collect, on its owfi, 
the information it heeds. It is likely that one organization 
Will be required to collect information needed by ^ixoth^r. 
This becomes difficult under a more ad' bnn approach. The 
potential incomparability of information collected across 



organizations will 
Furthermore, under 



Limit the degree to which this can be-dtjne. 
an>d hoc approach, it would be difficult 



to insure that a given organization would have collected infor- 
^ mation that is needeVj by or could be used^by another organization, 
especially if they petform diffei^eat activities. Under a formal 
approach, this can* be provided for by assigning indicators to ' 
dirganizations on the basAs of RDx-wide needs, and by establishiftg 
— -«qrocedures for sharing sucK information. 

C. Conclusion ^ 

J 7 . 

In designing the RDx monitoring process, it will probably be' 
necessary to find; a "middle ground" between these two approaches, 

^ ^he designers must make tradeoffs between the advantages and 
disadvantages of both. The degree to which one approach is 

. given more weight than the otl^er^mufii^take into account the 
conj^itions which exist tn RDx at any given ti»|,. the relative 
in^ortance of the several^ purposes of RDx monitoring whicli 
have been discussed, and the'^verall philosophy which will 
direct the design of RDx. 



In general, the- ad hoc approach should be fayored if rapid.^ 
learning, ^api^U)n^ efficiency <in relation to the sprecl- 
fic needs of separate organizatiol|s) and the deClsiOn-jnaking 
needs of individual j^ticipants s^e more important. It is 
also preferable if consensus on the infpJ:mation >rtiich should 
6e collected by monitoring is difficult to^^ieve. The ad 
'hoc approach is' somewhat more consistent with a view of RDx 
as an extremely loose, decentralized and voluntary association 
of organization^; vAll tend to be consistent with a shorter- 
term view of RDx (i.e., where RDx is viewed as performing 
roles to support the immediate needs of its clients);' and 
would probably be easier to develop (and perhaps therefore 
more viable) in early stages ot RDx development. 

If sach purposes as RDx-wide organizational memory, aware- 

s by participants of RDx as a whole, and provision of con- 
sistent RDx-wide information to' participants » are considered 
ore important, the perspective taken should tend to be more 
rmal. Such an approach wouldVbe consistent wj.t:h ft^longer- 
ange view of RDx system development and RDx activities, in 
which RDx provides ongoing suppott to member organizations 
and in which the orchestration and integration of RDx acti- 
vities is of central importantce. This .approach is more ap- 
propriate when consensus about the role of RDx and the im- 
portance of RDx monitoring emerges. 

It is important to recognize that these conditi^s and the 
relative importance of various jpurposes of monitoring will 
^ change over time. As will be discussed below, a major source 
of such changes will be the stage of development of the RDx 
and of the RDx-monitoring process. Another consideration is 
that the imj^ortance of the -various purposes of monitoring 
for a particular RDx activity will" vary over time 'and situa- 
.tion, resulting, to some degree, in a,natural fluctuation 
between the two approaches. 
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Ill, A FRAMEWORK FCTl RDx MONITORING 

I 

In this sectfon we develop a conceptual framework for RDx moni- 
toring* The purpose of this 'discussion is to^ provide an under- 
standing of one way to structure the RDx-monitoring process. This 
structure is, of course, oijly one aspect of monitoring. As a pro- 
cesSy monitoring must alsD be considered in a dynamic* manner . 
I This dynamic aspect is addressed in Section III;. Major Consid - 
erations' . * . 

The framework prpvid^s a set of categories, conceptual boxes, which 
serve as a way to differentiate different aspects of Rdx monitor- 
ing. ^The framework provides a structure for making decisions of 
this type by suggesting the range of inputs required for the de;^ 
cisioils; by identifying the kinds of design and operating deci- 
sions which .must be made; by suggesting possible way^ to approach 
, the identification of altematives-^frbm among which to choose in ' 
the' decision process; and by identifying and distinguishing among 
the. various activities ani processes which^ comprise tjie overall 
monitoring process in terms of categories into which they can be 
sorted. The framework alsc^ provides a way to consider the inter- 
relationships among specific activities and^ processes by identi- 
fying the relationship among the categories in which they are found. 

In this way, the framework .serves to identify major issues and cpn- 
siderations which should be taken into account in making decisons. 
abou(r and within the monitoring process. The framework can be used 
regardless .of the approach taken to monitoring: that is^ whether 
it wilt be more an ad hod or a forzaal process. While the location 
'o£^ and constraints on, decision making concerning monitoring will 
vary depending pn the^ approach -taken, the kinds of decisions, will 
remain essentially the same. 
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The f rameworl? discussed here is relevant regardless of the 
perspective, taken in. designing RDx monitoring. It is our. . 
position that a framework is needed for an ad hoc monitoring , 
proceas as well §8 for a, ^formal one. The framework provides 
a mechanism to establish monitoring activities. Under an ad, hoc 
approach, this f ramework ^aerves as a general guide which' provide^ 
any given participant with a^^tarting point from which to^ A 
develop its own rfonitoring processes, and raises issues which ^ 
could be critical in conducting monitoring activities. 
The framework provides^ a way. of thinking about these issues, 
and considering the interrelationships among them , in - 
terms of how they might have an impact on monitoring activities. 
"In addition, it provides the individual organization witli t 
set of suggestions concerning how to conduct monitoring activirties 
in such a way that Information is^ collected whi^ch will be ' 
useful to both. of them and to RDx. 

it^ degree to which a more formal approach is taken towards 
RDx monitoring vould,be reflected itt the degree to- which 
various aspects of the framework are used to formally specify 
what monitoring activities a given participant will perform ^ 
and how the^ will be conducted. In a highly formal approach, 'the 
full framework can be used to provide the basis for a formal 
set of formal procedures for RDx-wide monitoring and map of thof e 
procedures t9 facilitate "the operation of the monitoring grocess* 

N^us, the relationship of the monitoring app^ach taken by RDx 
^ fco^ifie frj'i(||work is one of the degree to whifch the' framework 
is used to ^rovid^ a formal monitoring process. The decision 
on what approach is taken is' a design. issue which cailhot 
, be made within the context of this report. 

\^ classes of Information v 

The range of purposes served by RDx monitoring require that sev- - 
eral types of information be collected by the monitoring process. 
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•A typdlogy of the information with which i;^nitoring is concerned 
provides a useful starting point in develop^nj^a conceptual framework 
for monitoring.. 

Stich a typology is also useful in desigpiqjg a monitoring processes Imce 
it provides a way fo -cjassify monitoring activities by the type- of 
Information collected. T^us, one can be^n to see how the 'xPbni tori ng 
process .is structured in teinns, of the underlying "Velationships among 
the olasses of information produced by monitoring, /^his will make it 
possible to describe the overall monitoring process and hew it 
is conducted in terms of |fhe principle output:- informajslpn. N 

The typology discusaed here is based on the different a^^cts ^ 
of Rlh?^ and its conteoct which are monitored. This linib; the 
classes of inforinatibn collected to the specific, foci of men- 
Itoring. This allows one to appro^xrh the overall monitprlng 
process In a way which n^kes it^ possible t6 specify and under- u 
stand where tooilitoring activities, should be directed. It thus 
provides ^ first step in developing an overall concept^l map 
of the monitoring ppocess. ; . . ' • * • \ • 



Other approaches to a typology are, of course, possible^. For 
exfitt^plfe, one could classify information^n terms of the spe- 
cific purposes to which it- Is put. Howeyer/ other approacl&s 
do not provider a me'chanism which, is as -useful in descrdbing 
^nd understanding the, overall monitoring process. 

:-, - . ... ]■ 

The monitoring proc'ess provide information about the states, 
conditions And activities .id^hin RE)x and in the educational 
"R/D&I conte:^ whicl] ia^eded by RDx participants and stake- 

vide 



liolders as 'ftn input^o their own . activities. This* inf oroa^ 
tion can^ divided inta five^ classes of information about 
activities internal .and external to RDx. * 
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TCRis class of Information concerns spectfie RDx acttvities- 
performed by RDx members . It fs unit-specific in that the 
\focus of such ^Sjtforrfatipn is the i<ientl,fication and .deSbripJtioo 
of the activities' that feach particigant is currently engaged in. 

.Such activities would Include need identifications, preparation 
of information synthesis, ior various service functions. 



This class of information focuses'ybn what activities are- beihg 
carried out by particular participants, hdw'they are being done, 
the time' taken by the activity and the inputs used for it,^ 
Such information Is often needed by other organizations as, an ^ 
.Input to their own activities • - • ' 

This class^D^ information is an important, input to the orchestratio 
of RDx, It can dfescrij)e some aspects of the st^^e^of development 
^ of RDx4»a« a whole in terms of the range of Activities, being per- 
fom^d, as well as the state of development of the individual 
particippants, vrhu^, it {)rovides a basis for allocating and' 
f channel ing^esourcJes to those participants. Such information 
^s an^ impoittant input t9 organizational learning, as well. By 
providing inforpoation bn what activities are being carried out, 
and how., RDx participants can determine how these various 

' " , ' - . : • ' 

activities .affect their own* 
R. > External Unit Activities .Infonhation 




A second fpcO$* of RDx monitoring concerns the specific activities 
being* F^r^ormed by organizations ixi the educational R/P&I context , 
suclj as univet^ities , educational labs, and local educational'^ 
agencies,The concern here is- t;h*e same as^-with internal unit. 
activlQLes: identifying' and describing the activities these « 
organizations are j>er forming, > - . 

•...•* • ' ■ ' 



276 



This class of information is impQrtant to estratlishing linkages 
with the RDx c^text It providle^ an input for determining how BJhi 
. affects ^and ds affected By activities! performed in it's context. 
Sucly^ information^ is also an iiq)ortant' input to decision making 
within the RDx (and tjcr specific RDx activities) in tikat it 
identifies sources, of education R&D *output vAich can be added 
- to the material disseminated by the RDx** It also identifies 
* organizations to whom user' needs can be fed forward, and \^th , 
whom^sers can establish Ilnjcages. Other potentially relevent ^ 
Context information would include: other dissemination/ feed forward 
programs or institutions; political dynamics which in5>act RDx or 
ejlucational R&D; etc. ^ - > ^ , 

t. Intgmar Unit Results Infor mation .J ^ 
'■~ ^ ' ^ ' ^ " * 

Tijis class of information concerns the identification and 
description of the results or outcomes of the sp ecific activijties 

/ • ; ' ' 

<jf RDx participants . V It is impprtant; to bear injjindvthat this ' 
doe& 'not include the 'fhll range of information produced^y such () 
activities";as-need identification or knowledge synthesi^ Rather, 
it is a summary description ^of dui:h* results and is based' on * 
particiiftr indicators such as the types of need identified in 
a particular case,- use to which a need identification was 
put or the nuirf>er s'outrces used in a'syritftesis^ thi's class 
of information* would Include, as well i such things as the ' 
results of ^ draining program-run by the Na^onal Service jCenters, 
the action taken, on a specific request f&r assistance by an 
SEA^or LEA, and so on. ^ ^ - ' . , • 

This infopnation is. important for the evaluation and orchestration 
of RDx it! that it provides- an input to determining the impact* of * 
RDx outputs. It can also be' important in'proyiding input to the ^ 
decisions and ^activities of other. RDx participants which have^ a 
need to kty)w^ :he- status pf. certain aspects of tfie RDx. - * ' 
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this cUss .of infdrmation concerns the wtcom ea from activltie_s 
> or.processes takiSig pl^ce in 'otganizations outside RDx. but 

relevant to it > It would include the results 'of particul^at R&D 
'.projects, the effects of a particular innovation in a, specific • 
, school,' the results of policy studies carried out on the 
. edufeational system and the like. ^ . ^ 

As in the other dfasses of -information, rtonitofing is only concerned 
with specific indicators ^o' aescribe such results.^ Monitoring 
'doep* not 'provide the means by which the detailed information, 
"about such results i| brought into the RDx.^ Monitoring'will only 
.identify the fact* that sm<^ Info-nnation is available. Obtaining 
nKi?e detailed informatiion can be done as needed by decision makers. 




Thia^lasa of information "i^s-lf pafticular iiq?ortance in 
establishing targets for \inking RDx with tjie^ucational 
R/D&I systto/and wi^h the' larger- ^ducationaJr context. It . ^ 
id^tifies where in format ion jexckanges will befmost' fruity 
ful, and which particular RDx participants shT^uld be involved • 
in liiiking with, p^firticular organization^xt^rna^l to RDx. It ,^ 
also provides information on conditions ip the educational R&D 
system and the context^ within which RDx operates which, may 
constrain or help RDx activities. Thus ;it is ah :lkportant in- • 
put to RDx decision making. . ' . 

• • . . ' ' ♦ > ^ • " '■ . 

•Such information provide* k basis for developing understandings 
9bout how RDX activities 4iave affected results "iti its context 
and howresuljis in the context affect RDx.results and activities. 
Thus, it is'in^ortant both 'to the evaluatipn of RDx Jjy NIE, . 
and for organizational, learning within' the RDx. 
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E. RDx Process Information . > - . 

The final class of ^(.nformation concer^ns the description of the 
interorganizatiorial relationships which, comprise RDx system 
processes . This information Vould include the state of the 
development of coramOnicatiou, p'hannels among participants and 
stakeholders (cf. Bean and Rogers 1977), the levels and typBs of > 
comrminication within those channels that exist, and such things as 
lnterorganizat;ional conflict and consensus (cf . Mojkowski 1977). 

This class -04 Informatiotl would also include the channels of 
communicatibn ^and nature oF the r^elaVionships between R^x 
organizations and organizati^ in the edufcational R&D system. 

This ♦iniorma?tfiot is useful as. an input t« evaluating •^the ^ 
development of t^e RDx. Indicators con9ertdtng the cuiyent levels 
of (Interaction amo^g pf rticiparits and wheje this interaction is 
faking pla.ce can be |ised to (iet ermine 'wher^^^jEurther development 
of RDx is needed,.' Suqh information pan ilso be u^ed to determi'ne 
the effects o-f different kinds and levels, of .organizational 
interaction on the results- 'of specific RDx activities. Thus, it ' 
becomes an •important* inpup to organizational leAming^ 



F> Reiatibnsliips Amon^ thy Classes ot Information 

The five classes of information presented here represent' a 
coticeptual break-down of the different foci of the monitoring 
I'^ocess. gudh a ^rcJak-doyn is^useful in locattSg where specific 
monitoring activi titles * should be directed* In otber words, given 
some speci^id purpose-.of monitoring -(e^g.^ orc^hestraticp) the tj 
^logy provided a^framework in i^hich to consider whatt-typ^s of 
Information are necessary input;s to that purpose. Having •idlntj 
ficrd tbe required types of information, pne can , then' ^jitablish' 
specific mo'nitoring activities to collect itA^/ -* y 
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It is clear in the discussions o^each class that information frotn^ 
different classes may be needed for any given purpose. Eactt class 
of information, vhile i't .provides a distinct input ta^some i>ur- . 
pose must be considered ,as part an. information "package" vhich 
is| sought for any given purpoSe.. 

; -V • * 

2 * • Time. Orientations . ^ 

A, major -distinction can be made ia, sjonitoring on the haais of the 
■ tto^ orientations which uiderly the intended use of the Information 

^llected.. As wfe pointed out above, at ,any point in time monitoXing 
pro^id-e information jrtiich is to be used a? Inputi to current 

Bite' activities or decisionmakilig. or to be placed in Organizational 
• 'nemory^for use in f u^re .activ/ties ot decis-ionmaking: This dis-. 

tlnction -allows one' to Identigy /two types of Information' , afitd-ln 
' turn, diffei^ntiate the. monj^ring.activities which produce i:his 

infonilatipn. / . ^ " * . 

yA* * Types 6f cinf ormation 

■ k> Current Needs Information 



/ 



^ ■ . - In tte monitoring ^rbc^s one can" identify, those 'indicators 

V ; ,* • * vjhicb provide' informationaf.inputs to cwrrent, operational 

* 7". .activities./ These l^idicators may be from <^y of the five > " 
closes of ipforr^tiori disfiussed above.. -The current-needs 
V : \ information would gdner^ly be t^r^mitted diredtly to thosp- ^ 

' Individuals or orgatiizations. which "reqiiire it. ' 

► ^ ' b. ' Future Needs' Information . • , , 

1' Some subset of the indicators in each of the' five classes 
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of i6form£^ti9|i will be rej^ant only^ In future RDx activities; 

luformatioa not needed in curr^r aictivt'ties na^^^^critical 
* In establishing trends or patterns over tlme,\or tVprqylde 
t background d^a £or such activities a^ evaluation, .golicy- 

making op organizational learning • ^ ^- } 

» * r 

^^formation of thi^'kind would not be directly transmitted 
decision makers. Rather it would be placed in organisational 
memory to be accessed and transmitted to userp wl^en needed. 



B. Relationship between Current and Future Needs Information >• 

The critical distinction between these two types of information 
lies in the purpose for Collecting a given piece\f 
information. This distinction provides a way to rVcognize tiat 
indicators of both kinds' are needed. Tlius, it can be useful 
in i^denttLfying the specific indicators needed, and of iur^er • 
sorting the indicatbrs used In monitoring in terms of their ^ 
purpose. * • . 

The distinction made does not directly affect the actual colle<^c 
of information.;, It i^ important, however, in , providing an input. 
' to't|^ linking function'-in monitoring. Under tho«e condition 
Viien information must be transmitted to decision makers* or to 
prgfanizational merory for storag# that^ is^ruci^^ to know. ^ ^ 



111 making this distinction,, one should bear in mind ttat scrte> 
indlc^tprs may be included in both categories. - Som4 current 
needs information may also be relevant for future needs. 'This 
overly between the categories makes the distinction more 
Important. It allows one to recognize that;^oae may have to 
transmit a given piece of information to a nuxnber of dif fer^t 
locations so that it can be used In a number pf ways. " I 
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*3* Location of Monitoring Activities 

r 

^yifether aspect of describing the structure of monitoring activi- 
ties concerns who in RDx is to collect information oh a given in-^ ^ 
dicator. Lbcating responsibility for monitoring activities wi^h- 
in ^he RDx is a major design is sixe. The discussion here extends, 
the framework in a manner Imich provides a basis for considering 
this design issuk»ip& 

A* Location by Groups of Participants / , 

o ' - ^ • 

f 

ilDx can bev thought of acs having fout major groups of parti- 

cipants: IJational Contractors, Regional'' Excbanges, State 

EdUcational^Ageneies and.NIE. While these, are not purely ' 

' homogeneous groups, therjj is farvmore homogeneity of-rol^ ' ' 

within these groups with respect to RPx than across these 

• • # 

groups. ^ j ' « ^ , ,^ * » * * 

This suggest:? that the need for information within ea'ch group 
- is inpre 'homogeneous than across* groyps* Thtoerore, these 
* four groups can be used as categories for describing %he 'over- 
all monitoring process and for approaching deaftgn' decisions 
about where. to locate specific monitoring afctivities. 

. ' B> Linkage ^ahd Transmission among Groups ^ • • * ^ - 

It is crucial to approach locating 6t the monitoring activities 
in terms of ^specifying where information ts to be collected 
and where that .information Is* ne^^ei. This must be*bdsed on* * 
a determinatigxi of the classes of information needed for cur-' 
rent and future activities by organizations in each group. . 
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e have argued^ it is importautVo re^<^ise that 
monitf^ring involves not only the collection of information, but 
also'^ its< tranayission to those decision makers who need the in- 
formation, and the linkages. which direct the transmission* , 

* and which serve ' to feed fcftward the needs of decision mafcers ^ 

* for specific. kinds of information. Thus,, it is essential that , 
the monitorin0process be understood in t^rms of the linkage and 

^ transmissiot/ relationships ampng the four groups of participants • 
• The monitoring framework, by including these groups, can be uflfed 
to ident^!fi^ general needs 'for information and to identi^fy where 
that information is collected. The linking function, in T)oth 
directions, can thus be. based on the framework* 

^ 'This provides eight categories of information. THe specific 
indicatjors collected by the organizations in each of the foftr 
groups, and* the indicators about wfii^h they need 'information^ 
I It ne^ed not be the case^ 'as we have argbe<above, ttiat a given 
organization will collect all of the information it needs, ' Jt , 
should also be ported out that, there is no reason to assume 
that a |iven organization will itself use or neect all of the 
^information it cpllectd^|||pphe' complexity* of *RDx..ia^ such that an 
Organization in .oi^' group may have" access to information (i.e., 
be able to monitor a given indicator) which is needed by another ^ 
organization which rannot monitor it itselSt In a purely ad hoc 

approach t^ monitoring, it would be the case that each group 

' V * • * ^ ^ 

collects the information it needs. ^This may result. in so«e 

problems if a' given group canptot 'get access to indicators 
which it needs. -. However, tj^is may be traded otf against the lower 
costs, no need for transmission ^ 'and ease of acceptance 'of an ad^ 
hoc approach in the .design of RDx. " ; 

At ^e other eJctreme, the purely formaflL apwoach vould view t:;^ise 
two dimensions as. independent. The decisions of 'who is to f 
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collect information would be. based on vhat is needed* by all ^ 
RDx participants. ' Each group would, be formally assigned a 
set of indicators on the basis of what it could collect most 
easily and inexpensively. The problem pf linking' and trans- ^ 
mitting this information to where.it is needed would be • " 
. considered separately. 

r 

In trading off between' these polar perspectives one can limit 
the degree to which organi2^ations collect information needed 
by . others. This limits the amount of transmission, required and^ 
begins to supply the overall monitoringil^rocess . ^ 



Thus,* the information collj^cted by each R]fe group must be understood 
as being interrelated across groups. Any given indicator used 
•by onej^af these groups may be part of in iafdfmatTbir"package 

needed for a givep purpose which includes information collected 

Ni ' ^ i 

- organizations o%s^other grdup. , 




4, Overall Framework , * 

We have noted three dimensions for differentiating among moni- 
toring activities: classes of information; current and future 
"needs for information; and four basic RDx groups. Thdse three 
dimensibns can be copbinecf to provide an overaStl framework f or^ ^ 
RDx monitoring. ThM allows one to identify specific categories 
of monitoring' activities in terms of the combinations of the three 
dimensions. This m^s it possible to fu^Hy describe the struc- 
ture ot»monitoring within RDx and to^i4entify the relationships 
amoi:^Jthese more specific categories." \ 



A; ^Categories of Monitoring 

As we suggested In the discussion of each aspect of the frame* 
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work, the three dimensions defined overlap each other. Any 
*giv€yj class of information may include indicators to provide 
information both for cuns^nt and future needs. ^ These indi- 
cators;;may be collected by organizations in *any of the four 
groups • These three dimensions are fully matrixed — any. 
cottMnation of the categchries in each dimension is possible • 
This is ' represented in matrix^ form in Table 1.- 

Each^cell of t^is^matrix represents a set of indicators. The 
X indicators wotild be identified in terms of the class of in- 
formation they . represent , ' vho collects this ,inf orm^tion, And 
the timefframe in \diich the .Infors&auionriff' iitiflfee'Jised. 
ditionally, the specific information needed vbuXd, of course , ^ 
be specified, \ , 

- . ^ . „ \ , ^ , ^ . 

This framework helps to iden|:ify.the .posstbirities of monitor- * 
ing. It does not identify, of course, -^at will be monitored, 
^ittevfi, or by yhom — these are 'design issues to be decided by RDx 

B. Interrelationship Among the Framework Dimensions 

• , » ' » 

The full utility of the framework tan pnly be realized whe^ 
the categories it provides ^re understood to tfe related. In 
the discussions al>ove we have pointed out that {;he more gen-- 
e^al categories in each dimension are related. It is also ^ 
the c^se that there exists a relationship aihong the dimen- 
sions which can b^ used to speci^^ the relationships amdng 
.the more specific categories in tjie^full framerwork5Wny 
particular monitoring ' purpose laay require information from ^ 
a xtumber of cate^ories\in or across the three^ basic dimen- 
8ions>G^'the full , ficamewor^. 
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; , IKe cate&ories are also related by the tied, between- where infor- 
nation isWeded and where that information is collected. The 
, complexity of this relationship w^ll vary.wifch regard to tha d^-. 
'''.j^-^*8igii'^j^ the monitoring process. "*On^^he one hand, each organi- 
• • saj^bii would collect only that information .which it needs. On 
the other h£^nd, the relationship between need and collec^bn 
becomes complex to the extent that organi^atiQjas colle^t\infor- 
mation of a specif i^type which is needed by^other organizations 
(and vice veirsa)* 1 • , , , ^ , 




The icategoxiea 'are also related in terms of the relationships, ^ 
among the specific indicators in each category?- A given indicator 
;aay be included In more than one category. By' identifying the * ^ ^ 
categories in which an indicator is included, one* can establish a 
basic relationship 'among them. Several other relationships of this 
typ^^ exist. Ind^-Qiltors are related when they provide the* s.ame - 
class of information. Indicators are. also related if they provide' 
information for 'the same purpose or for related .puifpodes. The 
relationships among indicat^ors, then, reflect the relationship ^ 
^among classes of information.^ Such relationships provide -a; way ' 
to limit the nun^er of indicators needed for the motiitoring 
process, v Any given'' indicator can be examined i^ the li^ht of ^ 
its relationship-- to other indicators,^ to JEtermine if it is . ^ 
necessary or if it only provides information available ^rqm other 
indicators. 



Some red.Ufidancy, of course, is useful in providing a means of 
checking, the accuracy .of information/ By cowparing highly 

related indicators one can determine if .theyjare providing the^ 
same infoicm^tioh. If not; there may be serious accuracy problems* 
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This is jQorb fully discussed, below under Meta-Motrltoring. 



^ It is also important* to understand the relatiotifiChips among ^' 

lndicatora:*when the Information theypproviJe is foij'inore than 
^,one purpo^d• In such cases inaccuracies in the ijiformation 
will undeptiine several activities. While any itiaccurac]^ iato 
be avoided, in such cases the pr'oblems are, more serious* { 

, A final point about the relationships among indicators is that ^ 
. ' it' prov^^des -a basi's for thinking about/ the* Indicators ujfeS^n 
i the overall monitoring-* process. By understanding tW relations 

ships among indicators one can determine tfTe utility of infor- 
^ mafcibin collected. by other parties in RDx for one's own activities/ 
If Mne other p*arty has information on a'^e^E^^f indicatgars related^ 
-,to ttio^e^one is - collecting, the information collected on 

'these indicator3 can be *a useful additional Input to one's oyn 
Information. • ' ^ ^ . ' d 



. C. implications of the Framework ' * ' . ^ ^ . 

• ^ f * , » - ' . 

We have said that the basic framework provided here is" a useful. 

input to open the design and operation of the monitor i\ig process. 

This section distriisses both of -these applications of the framework. 

{'■'"'■: . " ■ . 

- Design of Monitoriilg ' 

vThe p'rocesd of designing th^ RDX;.|poaitoring process cto be 
thqu^ht of , as 'essentially s'pecifyitig' tlie indicators whicli 
•are included in each * category^ This requires thdt^ there J)e ^ 
' /. '^sorae initial specific.at;Lon af .the purposes, of monitoring,^ 

such as those we have suggested above. , Tlj^is provides^ the^ / 
basis^^r es^^abli8hing the full range/oiE^iifprmatlon 
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needed by the monitoring process. 

The framework provides a way to characterize fc^^ information 
needs in terms of the classes of information, an^ta use 
in current and/or future decisions. The framework can 
aid in directing attention to the possible kinds of 

information which might be useful for any givep purpose. 
In other words, it asks if information of a given class 
is needed for a given purpose, and if a givyi purpose Re- 
quires that information be placed in memory for future use. 

The framework also provides a basis for identifying by 
whoni a given indicator is to be monitored. There are 
several possible ways to do this.' All mot^^toring may be , 
done by organizations in a single group. It may be the ^ 
case that each group cQllects information only in terms 
of its own needs. Finally, it is possible to design mon- 
itoring in such a way that each group of organizations 
^^ collects information (on a giveA set of indicators) which 

is needed by organizations in other groups. 

These decisions can be facilitated in terms of identifying 
by whom information is needed. This must be based on the RDx 
activities performed by organizations in each group, and the 
* purposes 'of monitoring associated with these activities. The 
framework provides a way to break these down and identify the 
extent to which there is overlap in information needs, and . 
t;he indicators associated with overlapping ne^s. This can 
be used to determine which strategy for designing monitoring 
is most appropriate.. 
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Ultimately, the framework can be used to provide a de- 
tailed* blueprint or map of the design of the monitoring ^ 
process from which the monitorrfig process can actSfilly ^ 
be constructed. It can specify the locations in RDx 
where the capability to monitor must be developed, the 
•actual indicators which must "be established and so on. 
We discuss this in more detail below. 

Operation of MoRltoring 

The overall framework is afi important input to the ef- 
fective operation of the monitoring process. We have sug- 
. gested above that monitoring involves ,three ba^ic func^ 

tions: collection, linkipg and transmission. The frame- 
work is directly related to each of these* As we have ^ 
already described in the previoi^ discussion, the design 
will specify who in RDx will collect information. .The 
latter two functions require this information as well as 
\ as the full monitoring framework. * 

y By specifying where information is collected and where 

it is needed, the map of monitoring provides a basis for 
establishing to whom the information collected in a 
given organiz^ition must be transmitted. Thus it proyides 
a crucial input' to participating organizations in dev- 
eloping Qommunication channels with other organizations. 
The map of monitoring identifies where such channels are 

needed for transmitting monitoring information and for* 

_^ _ 

feeding forward to those organizations cbllecHng^^ ^ 
information! needs for information of those organizations 
who need it. . - 4" 

1 ■ 

The map also provides an input to the linking function. 
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When a given piece of inf orma^tioa is collected an 
organization, the map can be used to determine the or- 
ganizations to vhich that particular piece of iafomatlbn. 
ia to^ be sent. It need not ^e the case that, all infoi;- 
iioation cpllected by a given organl^ixiion is transiai^ted 
to/other organizations. Ftirther, in£ormation that lis 
sent to some is different than that sent to others. 
Thus, the map can be used to prevent overloading channels 
with ' unneeded info3nnation« 

/ * 
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IV*. MAJOR. CONSIDERATIONS 



The fram^xfork discussed In the previous Section has treated the structure 

of the monitoring process. This treatment has been static — focusing 

t 

on the basic, elements which comprise monitoring in RD5k. However, 
monitoring is a dynamic process which must be understood as taking place 
over time Mid as being co;aprised^f the interactions among many indivi- 
duals and organizations* In this section we^ will address several issues 
which arise from the dynamic character of "RDx monitoring. • 



1* Inter- and Intra-Organizational Relations in^ RDx Monitoring 

- ■ . . ■ /, . • . 

No matter how it is designed, the RDx monitoriiig process will-entail 

interorganizational and interunit interaction. Monitoring .activities 
» * * 

may be diatributed across several organizations in the RDx, and across 
several units in any given organization. Even if a single centiral 
monitoring unit is established, the use of monitoring information will 
require that information be transmitted to^^;i^ious decision makers irv 
RDx. 



The inter- and intr^^rganizatlonal interactipns raise a number of 
coordination and conflict issues. In general, these issues apply at 
both the inter- and intra-organlzational levels^. ^ 



A. Differing Information Needs 



One issue is that different decision makers will h%^^ differing 

information needs. Thus, the design of monitoringjand'' subsequent 

monitoring activities must be coordinated^ with therfb^dif f er^tial 

* "A * 

information needs. Further, since we can' assiime tSi^' resources 

< * . ♦'^ . ' 

.are limited, not > all of the information needeit by *all Seclsiori 

makers can be collected in the monitoring , process .* .This poses 

a potential source of confj-ict vlthin RDx. If RDx' 'monitoring 
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is conducted hy each organization for its own needs on an ad hoc 
or decentralized basis, these problems will tend to exist on an 
Intra-organizational basis. The problems are compounded at the 
Itlter-organlzational level. * The problem becomes greater when these 
^different information needs are to be considered on an RDx wide 
basis* 

B, Information Flows * ' V 

' A second major ihterorganizational issue for RDx monitoring arises 
out of information flow processe^ -- both to those who monito^ 
and those who use mdnitoring inf <4rmatiQn. These flows of infor- - 
mation must also be coordinated to insure that .information reaches 
the appropriate people when needed in. useful forms. 

e 

The failure of smooth information flows can cause cdnflicts over 
the operation and value of RDx monitoring. For example, the failure 
of information to reach the decision makers, ^hen needed and In 
useful form can result in poor decisions and, therefore, 'in resent- 
ment toward the .monitoring process. The inability of decision 
^ers to influence the sorts of indicators being monitored and 
monitoring personnel can cause low leve;s of supp<kt for monitoring 
information. ^ 

Whiie mterV communicatlpns might'appear to be^less problematic. 
^Guetzkow (1963) has' discussed ;everal threats to the intra.-organi- 
zatlonal flow and understanding of Information.. 

. C. Unequal Development 

j .. ■ , 

The various organizations that comprise ^ may, at any given 
point' in ttoe, be at different stages of development snd thus 
tend to have different monitoring needs and capabilities. This 
can be true even among organizations of thd same type (e.g.: among 
RXs; among SEAS). Thus, ' the operation of monitoring mua.t be ■ 
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coordinated with these different stages of development in order 
to provide the maximal usefulness 'to different organizations. 
Otherwise, RDx monitoring can end up serving the needs of only 
a few organizations. This can result in resentment and eventual 
failure* to use the monitoring process fcy the decision makers in 
ttiese organizations.. It can also lead to, inter organizational * 
conflicts. 

' D. Need for Orchestration 

The above issues' suggest that, as the RDx monitoring process 
operates, there will l)e a need to orchestrate the various monitoring 
activities w;jLth respect to each other and with respect 'to other 
RDx activities. In formal organizations, such orchestration is 
often achieved through a hierarchy* of authority and 6rganizat;ional 
structure (Emery, 1969).' While such organizational tediniques 

" may be used within the organizations related to RDx, the nature 
of RDx is such that such direct attempjts to orchestrate ffay be 

. viewed as attemtps to^ control the participant organizations. This 
would be inconsistant'with-yche voluntary nature of RDx and could 

^ easily lead to low participation in RDx and lowvleveis of support 
for the RDx system. 

, - - t 

2. "When and When Not to Monitor 

In viewing monitoring as an ongoing opro cess one begins to* see that it is 
'lyasexi-"on the collection of information oti specific indicator^ over t^e . 
It is Importaut to recognize that in monitoring one does not continually 
coliec^t and transmit information on all indicators simultaneously. In , 
this section we address some general issues concerning the timing of 
monitor ingA activities and ^uggestJ 3omfe basic dimensions which can be 
used to design the monitoring process with respect to timing. By timing 
we mean simply when a particular indicator or is not collected or 
transmitted.' ' ^' , . ' . ^ 



A, General ^Issues of Timing • ' * . 

The question of when and when not to conduct monitoring- activities 
can be discussed in terms of several basic issues which are related 
tCb the timing of monitoring activities. These issues must be taken 
into account in any design of the monitoring process. 

a* Cost 



The collection and transmission. of a given, piece of informa** 
tion requires the expenditure of resources such as time» 
money and personnel. Clearly the mora information that is 
collected and/or transmitted, the greater the amount of 
resources that will he required to conduct ]nonitoring« Thus, 
decisions about;'how often to collect or, transmit infomiatlpn 
may at times be at least par/ly determined by cost cqnsidera- 
^ons . ♦ 

\ ' ^ ^ i . \ • 

b. Need and <J3e • / ' ^ 

J The ±B3\\e ^ere is simply tKat it is wasteful of resources 
fto collect and transmit infcnoati^n that is .not heeded or 



(for whatever reason) cannot be used. Here, however, consider- 
atibn must be given to information heeds and txseful^ess in the 
lon^ term' as well as in the short** teiqp. 



c. . Overloads , , 

The peoplfe who collect, traCiSndLt and use monitoring InfonrittloA' 
can become overloaded if attempts are made to collect and ^ 
/transmit more information than the "system can bear". • The 
sheer volume of information can become so great as to exceed 
the ability of people to store, process, analyzfe and* inter- 
pret it,. thus rendering it useless and leading tq confusion. 
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it 



When faced with great volumes of. information, individtials 
may have a tendency to place inappropriate emphasis on 
minor or random changes that occur in 'this information • 
Indeed, by providing more information 'than necessary 
.people may 'discover' misleading patterns, and come to 
•erroneous conclusions about what is going on.* 



e\ Inappropriate Information 

At ariy point inj^e, information on a givea indicator may 
be irrelevant or misleading. Some indiaatprs will be useful 
or meaningful onl^ at certain stages of a given RDx process. 
Indeed, ^ome will be n^^^jil only at certain^ stages of the 
emergence and development of RDx^ itself. Furthermore, 
different information will be collected for different 
purpo^ses, such as formative vs. summative evaluation. 
Providing inappropriate information not only wlistes resources, 
but can lead to making decisions based on mis]/eading factors. 

t 
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B. Dimensions* of Timin 



in designing 
into account 



Free uency 



• / 
/ 

the monitoring process, the above issues can be taken 

' / 

in terms, of twQ basfr fHniAiig-rnn.q. 




The more i^equently monitoring inforjnation for any given 
indicator is collected and transmitted, the greater the 
lifcelihcdd'of problems of tfxfe ki^s discussed above. .Thus, , 
indicators should b^^ monitored j^nl^ with sufficient frequency 
to / instre that changes in cpn^itions, etc. are picked up. 
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Thi^wl^l require somfe learning, of course, and tradeoffs 
may at times have to be *m^de when the needed frequency of 
collection {aftd transmission) could lead to the problems 
,f ^ noted earlier. ^ Nat lira lly,^some indicators will require 

more frequent monitoring than others, and some information 
wiir ne^d to be transmitted more frequently than other 
information. ' 

b. Relevance 



These problems can be lessened by collecting only infor- 
mation that is needed either currently or for futiire 
activities. Here> twQ observations are in order. First, 
relevance will vary over t£me. Some information wtll^be 
relevant only at* specific points in time and if collected ^ 
at other times can be inappropriate, misleading and a waste 
of resources. Second', over time some indicators^ will 
cease to be relevant at all. For example, some indicators 
• will only be useful in the, early stage of the emergence 
of 'RDx. When these Indicators are no longer needed, ^^hey 
should 'be dropped from the monitoring process. 



3* Monitoring and Memolry 

♦ 

The 'Operation of monitoring has within it a^arge component which Involves 

We can ndt here discuss in detail the structure or operation of organi- 
zational memory within RDx itself, or In its constituent organiz^ions ^ 
However, we can raise some issues about the nature of« organizational 
memory and the ways in which monitoring and organizational memory interact. 



A. Nature of Organizational Memory 



t 



Organizational memory refers to that information, knowledge and 
experieoice that an organization stores in some form for future 

\ ' ' , 

■\ • . • 
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reference and use. Organizational memory can use various storage 
laodes- .Perhaps the most familiar is some f orm |of computerized data 
bank and inj|(|piation retrieval system. , However, it is important t<i 
bear in mind that organizational memory T)as existed for far longer, 
than computers. Filing systems in» which tecords, reports, papers 
and other documents are stored, are a major form, of organizational 
memory • In fact, the memories of individual members of an organi- 
zation may be part of an organizational memory. 

CifcLtical to^n organizational memory is the abi^ty^ of members 
of the organization to access what is stored. Thus, members 
of the organization must know of the existence of organizational 
memory and have some idea of what kinds, of information exist 
in it. There miist be some mechanism by which information^ 
ki\owledge or experiences can be^ stored, TheVe must als^^)^ 
some t/hich permits members to access this Information in some 
form. 



Within RDx, one must recognize that each associated organizatibn 
will have some form of organizational memory,, although .it may be * * . 
informal and not well defined. These memorises will exist in-- 
dependently of any RDx wide memory. We refer to ihese as private • 

memories : those organisational memories which are\ accessable only 

/ \ * 
by members of the specific organization and iftto which -info^mafelon--^ 

can be stored. only by these members. Thus, these p)rivate memories 

may include sensitive Information or information that is not for 

exchange with other organizations associated with RDx., 



On the other hand, it , will be crucial that RDx itself have . 
an RDx-wide ( memory that is accessable by members of the 
organizatlLoiia associated with RDx. .As Rich (1977). points out, there 
is a need forSihe various organizations associated with 'RDx ttD 
have Recess to the experiences of other such organizations, ai^id to 
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^ know what they hav^a^one in various^ situations in' the past, and 
what theifesults Jiave been. An RDx-wide memory ^uld also have, 
iliforroation about the educational R/D&I context, ' . 

This feDx-wide mempry could be constructed centrally in one of the 
l^ional Contractor organizations.- This would then require a, set ^ 
of iammunication channels between the other organizations and the**^ " 
centifal memory. These channels^would permit each organizatibn to , 
access memory aT>d to store information in Memory (e.g. future 
needs information) . • • 

^ On the other hand, the RDx-wide memory could, be constructed so 
as to be distributed over all organizations associated with RDx. 
Each organization irould store in its own memory such things as 
may be. needed by other RDx organizations. In this case, each 
organization would have a part of its memory which is private , 

j and 'part t^hich is RDx. This RDx* ptirt would be accessablft to 
other organizations associated with RDx. * 

In constructing RDx-memory ^either strategy could be used, each has 
ad^^al^tages and disadvantages. - lE^s beyond the scope of this disr 
cussion^to address these. For our purposes it is only importtot 
to note tihat an RDx-wide memory should exi-s^i and that it may exist 
in some mix of these two forms. 

B. Interaction of Memory and^he Monitoring Process 

For, RDx monitoring to. operate fully and effectively, tbe monitoring 
process must .be conducted in. concert witli RDx organizatioilal memory 
As we pointed out in the conceptual discussion of monitoring in 
' general, there *are several basic -interrelationships. These can now 
be discussed in terms of RDx monitoring in particular. 
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a. Storage of Monitoring^ Inf6rmation 

>, * * - *^ 

1 

*As we discussed 'above, spme it^^ormation collected in the moni- 
toring process will be* specifically collected for use in 
decisions made^some time after the information Is collected.'- 
In addition-, record^ about the operation of. monitoring itself 

' should be kept to facilitate organizational, learning about 
mcfnitoring. The design of monitoring must; therefore provide 
for mechanisms to allow s^ich . information , to be stored in memary. 

, This,^ctivity_of storing, infonnatlon. As. .ident^^ to the.. link/ 
• transmission activity we have already discussed. In^this case, 
the collectors of; information must have a way to ^ow what 
information is to be stored, and where to send it to have it • 
Stored. 



Car6 must be taken to ^prevent the sj:prage of excessive ampunts 
of information in memory. * All of the issues discussed above 
in the section bn 'wlren and when not to monitor apply T\ere. The 
identification of indicators of the "future needs" type must 
therefore be carefully^ conducted — a limijed number shouL^ be.- 
chosen^ ^ trading off the potential "Ni^efulness of a gi?Uen piece 
of information- agaj.nst potential problems of storing ^t in 



alized. or located in the .organi- 



RDx-memory, whether this is^p 

zations themselves. The ^am^ipngers will be encountered in 
\ private as in RDx memory, so care must be taken not to store 
excessively in private memory as well.-* 



Another issue ^e^e is that the stbrage of RDx monitoring infor- . 
mation in memory Requires that the personnel performing the' 
linkage/ transmission activity have some mechanism which identifies* 
where memory is located which ^ill enable tliem to link infor- 
mation to the place or places to which it^is^to be sent to be ^ 
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stored. ' This la needed to Insure that Ihformatlon Is st6r^d 
in the appropriate place. If It Is not^ It will become 
dl££lc\ilt» If nor impossible, to locate and: access that 
inforniatlon in the future. 

b. Accessing Monitoring Information from Memory 

6iv^ that- monitoring information has been stored in memory, ' 
the problem becomes how to handle the process by which this 
information is accessed frcmi memory by those decision makers 
who need^t* This interaction between memory aad monitoring 
requires that user^ of information have knowledge of what had 
been stored in memory^ where it is stored and what steps are 
to be taken to* actually get the information. 



.He wat ji 



This requires, first of all, a mechanism like »at just discussed, 
which identifies where information is stored. It is, possible 

that a list of all information stored, and the ^torage location^ 

if > 

could be constructed, and used by eaph decision maker when a 

piece of information is needed. Given a computer opacity this - 

list could be. comput;^rized and made available relatively in- . 

expensively. However, given the complexity of monitqriing and 

the potential for a wide range of information, even this seems 

' inefficient and very likely to be so complicated that memory 

would not be used by a large number of decision makers. Even if 

the c^plexity could b^ overcome, it is tmlikely that any 

given decision maker will be able to master the r^ge of 

available ini^ormation^ and be able to understand the complex 

and often subtle interrelationships -among* available inforinar 
•* 

tlon. Thus, information potentially ^efuj. to the decision 
maker could ^^e missed. ^Developing such a medianism will, then, 
be difficult, but it is necessary. 

There is then a need for the establishment of procedures by 
whidi memory can be accessed. Such procedures would spec|.fy 
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the steps to be* taken to actually receive a given piece of 
information^ This might include specifications of who to 
contact for a given piece of information, the forms in which 
accessed information could be delivered,' the conditions under 
which a given participant may access memory, and ways to pre- 
yent directly accessing sensitive information without some device 
to safeguard confidentiality? 

An alternative approach to accessing memory wou34 be to provide 
a service within RDx consisting of individuals who are highly 
familiar with tl^e memory and can link a given decision maker 
directly with a range of potentially useful informaton through 
a synthesis process like Jthat identified by Rich (1977), in his 
discussion of InformaJ:ion Synthesis. By providing syntheses of 
existing information to decision makers, the utility of monitpring 
Information stored in memory can be increased, and the use of 
memory ty decisloji makers made more jef f icient and effectivi^!^ 

ill Purging and Updating Memory 

An> issue that i^ highly related to the when and when not to 
monitor^ discussion concerns the occurifence of the problems 
discussed In that section as a result of the use of memory in 
the monitoring process. We have already mentioned the problep — 
o^ ove^tllizing memory — storing more inf'ormation than the 
memory or monitoring process needs or can handle. The same 
set of problems can occur if the information stored in memory 
is not periodically updated. The continued storage' of ^putdated 
information can result in the use of- misleading information and 
the use of information that is no. longer valid. Since moni- 
toring* is concerned with conditions that ,aife changing the 
Information can Income outdated and must be corrected or up- 
dated to st^y valid. • * 
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Closely related ^to updating is the purging of outdated informa- 
tion. Storing data that is no longer needed can lead to ex- 
cessive storage costs and the danger that an outdated 'piece of-" 
infortoation is wrongly identified as, current and valid. Thus, 

misleading conclusions may be drawn from it, and inappropriate 
« 

decisions made* 

We do not mean to /Imply that all previously collected data 
should be eliminated. Indeed, t^ purpose of 'memory is to provide 
an historical perspective and to .prevent losing the benefit of 
past experience. However, care must be taken to Identify the 
information that will be useful in the future. Any Infor- 
mation of this type should be clearly identified as to its 
date of collection and its timeliness. Other information 
should not be kept in memory siiqply to have It available ^ 
"just in case." 

r' 

Neither does purging imply that any information should be 
destroyed . It means that information is to be mbVed^ to in- 
expensive, perhaps less easily accessible locations and taken 
out of vjhat might be called Active Memory — that memory which 
is directly accessible at a given time. By purging it from 
active memory, the danger of its misuse or misinterpretation ' 
is reduced. By retaining it, it can still be used when needed 
for forecasting or for an 'historical evaluation of RDx or RDx 
monitoring. ^ 

- 'V • , ■ • . 

Need for Orchestrating Memory and Monitoring 

The close connection between memory and monitoring and the high 
level of interaction .between them, requires that these be orches- 
trated* In addressing the orchestration issues raised in'' the 
discussion above, this should be considered as well* The success 
of monitoring requires that the interactions between memory and 
monitoring be smooth and not a source of conflict and confusion. 



Incentfives 



As^a loosely defined association of organizations, RDx becomes a 
difficult setting in which to orchestrate the interactions required 
by laoni^oring and to insure .that any guidelines with xespect to timing 
are more ^r less followed. As we pointed out, at the interorganizational 
leyl^, solt^ion'^. to sych problems become difficult without establishing 
what may be Jxerc^ved as an inappropriate and threatening control 
system. \ 

In addition, monitoring itself (and the exchange of information within 
and acrpss organizations it entails) may be considered by members of 
the participating organi^tions as threatening or too costly. Thus, 
^some may prefer not to particip^ite (or if participating, doing so 
at a low level of effort). By paictlcipation we mean several things: a 
di^^ect^^j>articipation in monitoring as a collector or transmitter of 
Information; indirect participation as a user of monitoting information; 
and/or having organizational activities being monitored. This l^st 
sense of participation may include "^simply alltj^ing one's activities to 
be monitored by.. people in another unit or organization, or Dionitoring 
such activities oneself * ajxd then providing this information tq others. 

These problems suggest! that a major issue in the consideration and 
design of monitoring is ti^e nature of incentive^ for^ active partir 
cipation in monitoring and for res^e^tlng or leg^L^imatizing the 
requiredf orchestration activities. In one sense, chis does not pose 
a major problem internally in most organizations. . FG^rmal reward 
systems ^do exist alongside formal authority structures. While these 
are not always effective, such nfechanisms generally do work or can 
be designed to work towards creating motivation and coordinating the 
behavior of organizational member's. The issue here, however, is the 
willingness of the organizations to apply their reward systems to ^ 
the needs of RDx-r elated monitoring. 
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At the RDx level, few such mechanisms e^ist. While it is true that 
NIE,/and the .National Contractors may have some power vis-a-vis the 
^. other organizations involved (based on contractual or funding relation-, 
y ships), ''it is vkot clear that this power is appropriate or eVen suf- f 
ficient to be used to insure partipipation or to orch^trate monitoring 
activities in a that will be accepted as legitimate by members 
of 'other organizations. 

Thus^ tHe problem becomes one of how to establish interorgatiizational 
incentives for active participation in RDx-monitoring with coopelration 
and a willingness to exchange informatidn and to otchestrate one^s 
activities (or have one^s activities be orchestrated} with respect 
to other activities. Incentives, then are defined as specific stra"- 
tegies to mediate the .problems mentioned. 

4 

A. 'Disincentives 

« Before one can address how to create incentives for RDx-monitoring» 
it is nefcessaiy to more specifically Identify the factors which 
will work to undermine participation, cooperation and orches^^ 
tion within the RBx-monitoring process. These are referred to as 
^ disincentives y Several possible disincentives c^ be. identified 



within RDx. 



a>' Cost 



Participation in -monitoring requires a commitment of organi- 
zational resources. Such resources to^y include, money, sta^. 
and time to be uded in the collection and transmission of 
information. Organizational oieifibers may resist committing 
such resources to the mbnitoring process.^ 



b. Organizational Changes 



Participation may. require making changes in the orjgani- 

'9 
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zatioa. New positions or organisational mit;^ may be required 
to .conduct monitoring activities. Newtitasks or^responsiljilitiea 
may be added to existing positions or imits*^ Organizational 
members may resist making such chairges in the organization. - . 



Exchange Apprehension i 

Org^izational members may fear the collection and exchange 
o^ intimation on their own activities, even if this infor- 
mation is^important ^s an input into decision making in other 
organizations. Thus, they may resist having thes^ activities 
monitored by\ther organizations in RDx or making such infor- 
mation available if they monitor it themselves." JThis is 
particularly important if such information is sensitive — if 
it concerns such ttiijigs as the success or failure of various ^ 
projects/pi^ogram's j^or spates of development of RDx- related 
activities. ' > 



ERLC 



d. Control Apprehension 

As we pc/inted out, orchestration of RDx-monitoring is necessary 
but the potential exifiJb for this to become^ or be perceived, 
as outright attempts to control RDx-related organizations* » 
. This applies to the tise of monitoring inf ormatiott in the 
orchestration of RDx itself a^ well as the 4)r chest ration of 
RDx monitoring activities^. This apprehension may lead to 
RDx-related organization reftisals to allow their monitoring 
activities to be orchestrated, ot to even orchestrate them 
themselves. It may also lead to^a reftisal to allow their 
activities to be monitored, refusals to exchange such infor-J * 
mation with other organizations, and, in general, refusals ^ 
to participate in monitoring in any way. ' ^ ^ 
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e. Other Pis lncer4t Ives 



These our disinoentives are by no means a detailed or 
complete list. Others can be identified at a conceptual 
level by thinking through' the nature of the RDx-monitoring 
process and of RDx as a ^hale. As the RDx-raonitoring process 
operates it is probable that others will be encountered. Thus, 
a more extensive and detailed list of potential disincentives 
should be developed before the monitoring process is deigned. . 
Such a list would be quite valuable in determining the degree 
an% kind of incentives needed for^ the monitoring process. 



B. Stra tegies to Create Incentives ' j 

- . ■ / 

Three general strategies can be identified to create incentives « 
to deal with these problems. 

t 

a« Direct Incentives ' N 

By direct incentives we mean those incentives created by 
\^ specifically establishing^ the legitimacy of authority relation- 
/ sl^ips* Most internal organizational reward systems are of 
this type. * 

The basic principle here is to overcome disincentives by . 
providing alternative reifards to compensate for the disincentive 
for doing a given behavior or activity, or by making the cost 
of not doing a given behavior orr activity greater than the 
disincentive associa^d with it* Thus; for example, pay is 
an alternative compenss^ion for the disincentives invalve^d^J^* 
a given job such as time sjpent away from other activities- 



>,^ 



•The creation of legitimate authority relationship refers to the 
relationships between levels in an organization, or between any socially 
defined roles or positioms. \This specifically entails a situation In 
which a person who is given ^directive by another recognizes this as 
somet^ttg^ v(hich is to be followed based on the right of the other 
person to Issue that direcfiv^. ^ SO*? 
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While such Incentives c^n be created internally within the . 

organisations associated with RDx> they are difficult » if 

not impossible »^ to establish for RDx as a whole. The cost 

o£ rewards and punishments would be high. Providing sufficient 

.rewards for'pdtrticipation require the commitment of large 

''amounts of resources. Further, negative sanctions may -^^^^ 

to resistance to RDx monitoring or even RDx as a whole. Some 

forms of direct, positive rewards may be appropriate for 

certain aspects of the monitoring process.,^ but the use of 

even positive rew^ds involves evaluation and fhe potential 

for feelings of inequality or unfairness in their adminis^jra- 

tion. Any ^use of such incentives should be limited and used. 

only in conjunction with other strategies. 

« 

Indirect Incentives " ' . 

An alternative strategy' for creating incentives involves dealing 
with disincentives themselves. Given that such disincen- 
tives can be specifically identified, an incentive can be 
indirectly created by removing disincentives. This can be 
accomplished by using one, or preferably bo'th, of two approaches, 

1) Design Criteria 

First, the monitor ii>g process can be designed /to ainimize 
the occurrance of dismc^tives. This requires that* 
specific design criteria be established to ^evaluate the 
design or operation of the monitoring process with respect 
to the disincentives. Such criteria can be established 

only by creating an extensive list of potential dis- 

f 

incentives. 

Such criteria would include such things as keeping the 
monitoring process simple ta its early stages to reduce 
confusion about how it operates and to keep the costs of 
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ittonitoringMower. ' A 'design in which monitoting activities ' 
are spread out over several organiz4tions would remove* 
disincentdS^es s€eraming from imposing a large number of new 
activities on any particular organizati#a» Disincentives 
stemming from c^ncerng ov'er the use gr exchange of confi- 
dential information could be removed by either limiting 
the amount of confidential information collected ox trans- 
mitted, or by masking the specific org^iz'ation to which 
suc^ confidential information refers. 

At a laore gen^^ ^v^el, the disincentives which may be' 
inherent in the monitoring ^procqss can be minlffliiged by 
designing monitoring activities as natural extensions of 
other activities perfprmed witWp the organizations associa- , 
ted with RDx. ' The costs o$ and Resistance to monitoring 
can be reduced by locating the monitoring of specific 
indicators in organizations or units which are, or should ' 
be, already collectiitg such information for* other treasons. 
When information that is not, already being collected by a 
girven unit or org^nizatigj^i is- needed by the monitoring 
process, resistance tp increased costs 'C^n be reduced by^ 
having those un:^s which have a need or use for the infor- 
mation collect it. SiMlarlye, the Aking/transmission 
activities could be carried, out by those units which 
already- engage in such information handling activities. 

7^) Establishing Mechanisms to Reduce Disincentives • 

Some disincentives may stem not from the monitpring design bUfc 
from the' interactl^ijn of drgatii'zationa or units in the opera- • 
tion of monitpring. Stich disinAentives can^e reduced by 
providing Various medianisms to^taediate between organizations 
to solve -problems they perceive or experience by virtue of-- 
engaging in the monitoring prqpess* 
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For example, conflicts between an organization monl'torlng and 
one being monitored may occur ovet^^at information is mafle 
available to the in^it ot organization carrying out*" the 
monitoring of a given indicator, Reslsta|ice to monitoring^' 
may restjlt on bo'th sides as a result bf 6\ich' conflict, or 

evey In anticipation of 'conflicts- Tear of conflict may 

, ^ * ' ^ 

become a critical disihc^i^ive^ This dl^ incentive, can be 

reduced by establishing spmejclnd of conflict management 

mechanism within RDx, such ^^^"^arbitr^t ion by the RDx Manage- 

;nent National Contractor or by c]:eatlng a special group 

within the 1EU)x monitoring process to clar;Lty ainy confusions 

• ' » * 

about the design^ ; ^ ^ > . - 
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Another disincentive of this kind would .involve fear on 
the part of membe^rs of ^he organization that Information 
generated in the monitoring process is^ bBlff$ us^d by members 
of another Qrgan;Lzatlon to c&eate a power base xd.tliln RDx* 
The fear o£ inappropriate uses' of- information can provide * 
a major disincentive within RDx-moni to r ing. ^ ,Tlfi^ cannot 
be dealt with In jthe Resign of^tlie monitoring process, but 
can be reduced by creating a ^process by vrfiich the^.uses of ' 
monitoring infonnati^on 3re -themselves monitored, to check 
that information is not being t^sed inappropriately* Another 
stirategy here mlgti^ be^to creajte a process in which complaint's 
about the uses l)fi monitoring information can be Investigated* 
By reducing the likelihood of y^^pproprlate uses' of 
mati^n, this should become less of a .df^^centlve. 

A major disincenti^ve\ that iris'e out of the operation of 
riitorlng Is confusion about how fiohltioririil aptivitiea are 
to be performed and ^how a given tiXs in witlv others. 

^ faced with something ^ compleset^ the monitoring jproces'sjs 
members of organizfittions or-^&ilts may^gi^ek to avoid parti- 
capating berceuse they don't understand JBi^nd^re afraid of 
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' the mknown consequences or responsibilities involved. ^ 
This could be off.set by establishing a program 

. to educate members of the organizations associated with 
RDx about the nature of "the RDx-snonitoring ptocess; how it 
operates as a wijole, what .ig done with the information and 
how the various r^es in the p?bcess are carriedjDut. - Such 
an' educational program.-t:an reduce the apprehensions about 
Vhat is ejected of participants in the monitoring process, 
about the uses of ^nf ormation to control or inf lu'^nce the 
organizations involved and abotft the. relatiox^hip of 
RBx monbioring to other RDx functions or processes. 



c* Proactive iiSp^oaches' to Incentives 

Another strategy for creating iricdntives for-participation in 
the monitoring process i*s to, take a proactive stance with f ^ 
respect to incentives — undertaking positive actions to 
create a situation favorable to participation rather thJa > 
merely reacting to existing conditions. Thus, in a proactive * 
strategy, natural, incentives, would be 'created by having RDx- 
r^lated organizations recognize* the importance <of monitoring . 
for a€H3^g^d5i^^^ their own objectives and those of RDx. 

The first approach, theh, Wbuld be^to demonstrate the Importance 
and. value of the monitoring process to the* success of RDx 
ad a whole. If we assume that there a|Lready exfiftts some level 
of commitment to RDx (and why else wuld various J^rganizations 
be involved?), it follows that demonstrating thelKped for. 
monitoring for^the success of RDx sliould lead to ,8ome level ^ i • 
* of cclimnitment to monitoring. Such a demonstration must go 
beyond 'information about the internal operatioit*of thUaonitoring 
^ocess.. It must focus on the rationale for the exiistance 
and use of monitoring within RDx, its Impox^tance to RDx, and * 
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the kinds of cooperative exchange of information and openness 
required for its, success. 

•\ .. . f 

The second approach would be to bxiild the monitoring/ 
information needS/ of the RDx-related organizations directly 
into the design of monitoring. By more directly supporting 
the particular needs of these organizations, monitoring 
should become, more obviously valuable to them. 



In this approach it becomes critical to monitor the infor- 
mation nee^^ of the constituent organizations to be aware 
ot changes ik their needs. Here, then, we are really ^ 



talking' about larocess similar (but not ijy^tlcal) to nj^ 
assessments carried oUt'by RDx- in its other activities. 
Mdny of the same techniques can be applied to the design 
and operation of Rt^rmonitoring. 

Since not all ndeds can be served* at once, a potential ^ 
problem in both the theSje approaches Is that tjradeof fs 
must be nwxd^f Since diffferent organizations wfllVave 
different nee^ds for their own activities and different 
perspectives on how to best accomplish RDx objectives, 
somebody is likel^r to be dissa^sisfied at any -given time. 
ThiQ problem can 1^ Refused to^obm extent by having members 
of the various organizations participate in the decision 
making with resect to the needs ser\^d and kinds of infor- 
mation provided^ty the monitoring proems.* By participating, 
members will have an understanding of whV certain things are 
included a^id others excluded and have a deg;^ee of xiommltr 
ment to the decisions reached. . * 

The implementation of monitoring itself can be used to help 
build these natural incentives. By developing monitoring / 
first with those organizations where Initial interest is 
both positive and high, one can take advantage of what amouiits 
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to^an already ^existing incentive for .participation. By 
segmeating the development of monitoring in this way, one 
can give tooni}:oring ^ chance to be demonstrated as usef ixl 
by 'its own operation. The use of organizations for which 
the incentive already exists can help insure that monitoring 
will be successful enough to be demonstrated to other organi- 
izations. ' ^ ' • 

4 

These methods can. ail, be enhanced by identifying the locations 
dnd causes of resistance to monitoring. This information can 
then be used to reduce this Resistance by working directly 
with these people through specific consultations and explana- 
tions of the nature and utility of monitoring and even bj;^ 
building into monitoring specific valixes for the organizatioas 
these people represent. 

This overall strategy can be considered ,as marl^et'ing, in its 
best sense. The basic idea in marketing is this kind of ^ 
demonstration of value and utility of a product or service. , 
A proactive approach to incentives ^or participation in . 
monitoring 'can benefit from taking advantage of the skills and 
techniques of marketing. 

e. " The. Need to Mix Approaches 

No single approach to building incentives or removing 
' disincentives is likely to be sufficient in and of itself 

to* insure eff ective"%Dx monitoring and commitm^t tp RDx 
-'>ponitoring. Disincentives can be reduced to some extent, 

but ft is not like^ that all' disincentives can be removed. . 

By itself, a proactive approach would not be sufficient if 
'^thfe disincentives are strong. The very neimess and complexity 

of monitoring may themselves create a threshold of resist- 



1' ance which must ^overcome before members of these organi- 
zations are willing to participate. This threshold may 
require the Jbe of jprqactive strate^^es to overcome r^sist- 
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^ This issu^^ compounded by recognizing that the removal'^ 

^ ^ of disincei^ivybs is difficult and expensive, ^ven if there ; 
existed enougtt .resources , it is,not likely th^t there <d. 11 
^be^enough understanding ot all disincentives to permit tliept 
identification and removal, especially in early stages of 
development. These must be learned as RDx monitoring* 
Opiates. Ijideed/the complexity of monitoring is such that 
itMnay ivpt be ppsfeible to ever design a monitaring^ prot^s 
I ' ^ . ^ich has- no' disincentives. By the satne token, the cfAtlon . 

^ . ^ of incentives througiTproactive, strategies is. e3q)easiye and 
s ds*not a well understood process. ' " - * 



However, these'^aridus strat^es ,c^ interact."" By reducing » 
disincentives and increas'inf^tte midgrStanding and rfecog- ^ 
' nitioh of the value of monitoring(^ incentives can be created 
. "^without total commitment an^Tthe e3i:iS*tence of some disincen- , 
tiv^ can be tolerated. Thus, a- mix of approaches would 
see^to be the most powerful and efficient mechanism for 
-providing ioQent;ives for monitoring. * / • 

5> MonitJrip p; tha, Monito ring Process ' ^ 

AS the monitoring proc^^ess operates, /t will be necessary to collect 
information about its operation. l/ o.th^words , the B^onitoring proces^ 
itself must be monitored. Indicators concemiiig monitoring itself must 
be identified and procedures e>t4lished for the collection and trans-^ 
ndssion of ;iAformation' about them. We refer to' this process of moni- 
toring the niandtoring procesV as gpta-monitorinfi . ^ ' 
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A, Purposes of Meta Monitoring 

A^jor purpose of meta monitoring is to proviie*information 
for the orchestration of the monitoring process. If orches- 
tration is handled centrally (or by mutual^justment by the members 
of orgailizattons involved in monitoring -themselves) , information is 
needed about the activities being conducted by other people involved 
in monitoring. If monitoring is being conducted on an ad hoc 
basis, such information would be useful tot directjtng monitoring 
activities in a given organization, and for providihg^^x itself 
with a picture of the overall nature and level of activity and 
the state of development of monitoring in the various organizations. 



Meta-monitoring can provide a basis for determining when support 

by Rlix would help develop and strengthen the monitoring process. 

* '» 

Information about monitoring will be a crucial input to the 
organizational learning process in RDx with respect to monitoring. 
The complexity of monitoring makes it unlikely that;a full under- 
^ standing of how monitoring functions 'and how it should be conducted 
can be obtained without a good deal of information about its 
actual operation. The experiences encountered in monitoring are 
an essential in learning how to monitor . 

Finally, meta monitoring is essential in evaluating the overall 
effectiveness of the monitoring process. Thij^^aluation involves 
three thin^ First, -is monitoring in genet|^^tually useful 
to RDx: is the information collected cqatributing to the success 
of RDx? Second, is monitoring.- as it is designed and conducted ^ 
working effectively: does the design require modification? 
Third,, is monitoring (as designed at any poiftt to time) sufficient 
to RDx needs or does it need to be extended? 
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It i8 Inportant to bear in mind that these issues are relevant 
even in a pure ad hoc approach to monitoring. Even if there is 
ao "central RD^ role in monitoring, there is a need for this kind 
of information about monitoring activities across organizations.' 
Furthemtore, any given organization must be concerned with 
evaluating its own internal monitoring process for these same 
reasons: monitoring must be orchestrated internally, it must 
be supported, learning about it remains critical and Its over- 
all effectiveness and utility must be assessed. 



B. Criteria for Monitoring: What is to be Meta-Monitored? 

The indicators used in meta monitoring must be based on the 
purposes it serves, and these purposes all relate 
to some kind of evaluation of monitoring. Thus the ind^tors 
must be tied to specific criteria about monitoring. The 
criteria and the indicators to be used in meta monitoring can be. 
derived from the discussions about the framework for -monitoring 
and the previous majo^ considerations. These can be organized 
around four central issues that reflect aspects of an answer to 
'the question "Is monitoring working?" 

/ 

a. Hnl lection and Transmission of Information; 



•A major issue in evaluating monitoring is a concern with whether 
information on the indicators specified for jae in the monitoring 
process is being collected and transmitted, ^andvrfiether this 
is being done appropriately... Criteria here^/ could include • 
the following. , • • / . • 

- Information from indicators specified in the design of 
monitoring is being collected. 
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Information on a given indicator is being transmitted to 
the relevant decision makers and to the appropriate 
memory. 



- 'Information is transmitted while it is still timely. ^ 

- Information is being collected and transtaitted only when 
it Is relevant. . . . ^ 

- Individuals collecting information and lihose using it 
are not ove^lo^ded* 

- Memory is being purged and/or updated when appropriate 
and £s not overloaded with irrelevant information. 

- Channels for the transmission of monitoring Infqn^ation 
are aval lab le> known and being used. 

Information of this type can be useful in determinlns where 
the Interactions among organizations (or their stibunlts) . are 
hindering the process. It can be used to determine the. 
extent .to vhich the operation of the monitoring process ' 
conforms with the desi^. It will also aid in determining 
specifically where monitdring is breaking down, if anywhere » 
and where effort is needed to "repair" it. ^ 

' ' ■ <^ . 

b. Utility of Information 

Another issue In evaluating monitotlng concerns the useftilness^ 
of the Information collected. This specifically centers on * 
the users of information and their reactions to and tiaes of 
thla Information. Criteria about the utility of the Infor- 
mation should reflect the Impact of monitoring on these decision 
makers and their activities. As such' this class of criteria 
gets to the .very general issue of whether monitoring Is indeed 
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serving .the purpose for which it was designed. Some criteria 
concemiag this could include some of the following. 



- Information provided by the monitoring process is actually 
. being used by decision makers. ^ 

- Indicators being monitored reflect the needs expressed by 
the tisers and potential tisers of monitoring information. 

- Decisions made within RDx are improved by the input of 
monitoring information/ 

' % • 

- Decision makers request existing monitoring information 
when conducting specific activities. > ^ , . 

- Decision mak^rt^ r-equest that, additional indicators be 
monitored. , 

- Users of monitoring report satisfaction with the information 
provided., 

These crite^ria should be applied to each indicator used in the 
itonitoring process as well as to monitoring information in 
generair^^ Information of this ^nd can 'thus be used to help ' 
determin^^ those indicators which are not useful and' should be 
dropped as well as to evaluate the overall utility of monitoring 

- " . • ( 

Information on Design^ Operation and De velnptnent! 

Apart from issues abqut the collect ion/ transmission and use of 
information, a class oi relevant criteria concerns the design 
of monitoring itself.^ In this class the Issues center on the 
question -of whether the design itself is Interfering with the 
monitoring process, and undermining its utility. Criteria. In 
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this class could include the following: 

- Is the approach — ad hoc or formal — appropriate to the 
needs for information on monitoring? 

- Can decision makers get all the information they need given 
the approach? 

- Is the design flexible: are indicators being adapted, or 
replaced with respect to changing condition^? ' 



- Does the design have f^^tures which are creating disincentives 
for participation? - 



- Are the incentives provided working' — are people providing 
information to monitoring personnel? 

- Is there sufficient flexibility in the design to allbw 
e:iq)erimentation to facilitate learning about nonltorlng? 

- Are issues regarding when to monitored considered? 

- Aire channels overloaded? \ 

Are capabilities developing? 

These criteria provide a basis for evaluating the de^^i' of 
monitoring. This will facilitate learning and making changes 
In specific aspects of the design and modifying the approach 
taken based on the actual experiences with monitoring. These 
will also aid in identifying conflicts or Inconslstandea in 
the design which may. require specific efforts of orcheatratSbn. 
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4, The Development of Monitoring 

The creation of the RDx-monitoring process cannot be accomplished 
In a single effort, nor may all organizations be able to develop 
the' capabilities needed to participate in monito^ng at the 
same time. Furthermore the monitoring process must adapt' over 
time to changing needs within RDx and to new conditions in the 
RDx context. Thus the monitoring process must emerge and 
change over time, and this pro gess of change must be monitored 
as wel^.. Some criteria here would include the following: 



- * The design of monitoring is flexible: new indicators ar^ 

added, and old ones dropped. 

- Different organizations are at approximately the same level 
of development. 

- Among those organizatipn^^iJarticipating, capabilities for 
monitoring are developing rapfdly enough to provide ' 
needed monitoring information. 

r ■ 

- New channels for trMsmission are being added as more 
Infopnation is collected and as additional organization or • 
subunits request it. . 

- User needs for information are being identified to provide 
a basis for extending the monitoring process. 




- The overall devel&pment of monitoring is consis tent | with 

the Intended directions for development. 

These criteria will permit the orchestration of the develoilpment 

of monitoring over time to insure a sufficient level of . 
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consistency in tke development of monitoring , for its operation* 
They will help^ pinpoint where support is needed by a given 
organization t:o speed, up its own development of capability. 
Thoy^will alsp provide a basis for deten^ning yhere the develop 
.ment*of the monitoring process requires redirection to insure 
that' at any given time it is operating as. intended. 

C. * Design of Meta Monitoring ^ 

The meta monitoring process can be designed in the same manner as 
monitoring itself. The starting point must be the purposes to be 
served by meta* monitoring and the criteria used in the evaluation 
of monitoring such as .those we have (Jiscussed. Given these^ the 
design of the meta monitoring process must consider the same 
issues as have been discussed lEor the monitoring process itself.*- 
These issues include: \ ^ 

1) Indicators 

As with monitoring, meta monitoring indicators must be 
^ established based on the types of information needed both 
-< for current^and for .future needs • The criteria for the >^ ^ 
conduct of monitoring activities, the utility of informa- 
tion provided by monitoring and the effect of the design 
on these thus provide a basis fot identifying and picking 
indicators to be used. 



2) Who Collects Meta Monitoring Information' 

As in RDx monitoring itself, the Issue must be addressed as 
to who should monitor monitoring, ^^le Issues rals^ed above 
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concerning access to information, cost differences in who 
collects this information, and so on are equally in^ortant ^ 
' here. As before, it is important to recognize that different 
. organizations or groups of organizations may be able to 
collect Information on different indicators more effectively 
or with less resistance than others. The questitsn must be 
whether to have each group of organizations collect different 
information on different indicators, cojLlect information of 
the. same indicators, or to have a sin^e organisation or 
group of organizations collect information on all indicators. 



3) Who Needs Meta Monitoring >Inf ormation 

The other side of the "who'* question is where, meta monitoring 
. information is needed. It is important to note that each 
group of organizations associated with RDx monitoring will 
have an interest in evaluating monitoring in terms of their 
own activities, short term orchestratioh of their om 
activities with other activities in RDx, and more long term 
evaluations of the usefulness of their participation in the- * ^ 
lU)x monitoring process. This implies the need to identify 
•the indicators on which each organization or group of 

organizations needc>meta~monitoring information. > 

i ' ' ' 

These issues can be represented in an overall framework for the 
design of meta monitoring. This is shown in Table II. It* 
parallels that framework prbvided for RDx monitoring itself. 
Its use is the same. By locating indicators in the cells it 
is possible/to design and describe the structure of meta 
monitor ing.\ As with monitoring, metee monitoring must be approadied 
as a dynamic process. The considerations discussed earlier 
concerning interorganizational relations, orchestration, timing, 
memory and incentives all apply in the same way to meta monitoring 
as , they do-to monitoring itself. 
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V> DE^fELOPMENT • . - 



* ft * „ * 

» , » V o 

The discussion up to this^ point has been cbncemed with providing, a 
range of ^concepts and def initionfi relating to "Various asp^tts of** 
noxiitoring processes in generdl ^d t:he RDx monitoring process in . 
particular. These concepts can be u^ed as a basfs^or organizing 
one's thinking about i^nitoring and are Important ^considerations 
in the actual design and operation of, monitoring witKiii RDx. In - 
this section we will make use of these concepts to address ^tw6 
issues related to design and .operation of monitoring: the 
establishment of IDx monitoring as a yiable^rbcess and, the trans- 
lation of these concepts into concret^*, specific aspects of an 
actual monitoring process*, * - . 

X* Overview ^f the Development Process" • ; ' 

Pragmatically, the establishment' of HDx monitoring mtist bet seto 
as- an JLnbremeil^al process Developing a full-blown RDx monitoring' 
system in one fell swoop is not a viable option becguse: ) 

* \ ^ ' 

^ monitoring is a complex process; 



experience with RDx and with RDx monitoring will be 
needed in order to develops our xindfergtanding of them; 



accep;tance of and support ^or RDx (and thus even more sd 
for RDx monitorlng> is not yet a "given"; . 



as RDx matures, ch^ges in its^urposes, context, parti- 
cipants and activities will occur changes w^^h will, 
require changes in the moxiltQrlQg process (cf • J^ah and 
Rogers, 1977); , . 

similarly, as RDx monitoring itself filatures over time, 

I ' , . . 

changes will be needed* ' , * 



We thetefa^ conclude that RDx monitoring should emerge incrementally 
over ^isne — a prbcdsa we refer to as the development of RDx 
monito^dng. This process xd.ll thus involve many "cycles" of deyel<* 
opmenK. In each cycle of the development process, the concepts 
that wa/ have discussed in the paper so far must be translated (i.e», 
"operat'ionalized") into the various' aspects of the design of moni- 
toring; activities, indicators , processes » structures, responsi- 
bilities, etc. ' ^ 

IT 

While ve recogxiize that a develbpioent process is not ahteigrB a 
"clean-cut", linear process, it will be helpful , (especially in 
initial stagesK^o consider the development of BDx monitoring as a 
prs^icesa consisting of four b^asic steps ~ plus a "redesign step" 
which starts the development process again in a new "cycle" (see. 
Figure 2): f 



\ 



1) Design 



Translating concepts into specific facets of a design^ 
translating needs for information about various aspects 
of RBx and its context a^d operation into indicators; ^ 
translating collection, storage and transmission of 
monitoring information, into xesponsibilities of personnel 
and organizations; translating th^ need to share infor- 
mation among the participants in ^Dx into interorgaiolza- 
tional channels .for Information trmismission and exchange. 

2) Build 

Translating the RDx monitoring design into actual capa- . 
bilitles. 

3) Operate ^ ^ ^ 

Translating the RDx monitoring design and capabilities 
into actual, specific activities for collection of Infor- 
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Figufe 2 
FRAMEWORK FOR META -MONITORING 
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station by monitoring Indicators, transmission of this 
Information and use of .this information by decision 
'loakers* 



4) Evaluate and Learn 



Assessing the appropriateness and ei|;Eectiveness of RDx 
monitoring design and operation in terms of the effects^ 
of monitoring^ on RDx; the usefulness .of monitoring Imfor- 
mation;^ the constraints within RDx^or i^s context which 
interfere with the operation of monitoring; coats » incon- 
sistancies and other design problems concerning monitoring; 
changes in the stage of develo^pment of KDx; changes in 
the educational R&D system; changes in the ^purposes ^and 
participants in RDx; forecasts made by RDx participants 
about future changes; or changes in the understanding 
of RDx and its* context that result from organizational 
learning. 



ERJC- 



Ve may note here two points' about evaluation and organi- 
zational learning. First, it is Impo^Eant that meta- ^ 
monitoring processes and criteria (i«e», monitoring o-f 
RDx monitoring) be included as part of ^he Initial design- 
process in order to insure that infprmation relevant to 
later evaljuation and 'learning will be obtained* Second, 
' the^ evaluation of RDx monitoring is^ in general, 'based 
on the experiences of RJDx p^rticipaiits actually involved 
in monitoring. - As the monitoring process joperates, 
organizational learning sh^nld^ccur a3 problems are 
encoufitered and solutions are tri^d, and as information , 
shared across organizatit>ns about different experiences 
with monitoring. Such sharing of Information about the 
outcomes of actions -taken is crucial for organizational 
learning ta occur — ^eart^lng which increases our 
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uncTerstanding of how thd monitoring .process ^'orks. <^ • 
* . * *' i' 

5)^ Redesign 

Beginning the next "cycle" of development. 

Redesign may focus either on modification (including 
termination) of design aspects which are judged inade- ' 
quate or inappropriate, and/or extension of the scope o^f^ 

RDx monitoring. ' p» » , 

' ~ & 

Redesign maAfee based onincreasedlhi^erstandings about ^ 
.JRDx monitoring (how it^works, what impacts its effectiveness); 
' the modification or extension of the purposes^ or activities 
of 5Dx as it emerges and matures over time; the emergance , 
' ' * o£ new factors in th^ context^ot^^t^tich as new types, pf 
producers of educati^ai innovation) and changing condi- 
tions^ in the context (such as new sources of funding) . 
Under the above conditions, new indicators may be needed* 
new procedures developed or other changes in.mqnitoring 
' made. ' . , i ' . 

Two further poixts may be »ai|^Ahere. First it should b^ pointed 
out that a range of ways of organizing and -carrying^oiit monitoring 
activities is needed, at le'ast in early stages of the development 
of the monitoring process, to provide a basis for establishing ^ 
what works and what does not work. Second, .because the development 
process involves the adaptation o^f monitoring to changes in the 
RDx and its context,- development will continue after the monitoring 
process has become operational and Is establishe4 within RDx. 
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4 

!• Step No.lt Deslgniok RDx Monitoring 



A. Initial "Base Decisions" 



While the total » long tarn developicent process for BDx monl-* 

torlng my be deen as a series*" of developmental cycles, there 

must^be an Initial "starting point" from which to st^rt the 

development process* That Is, there are some Initial "base 

decisions" vhlch must be made as BDx policy before the first 

*deslgn/bulld/operate/evaluate cydL^ *beglns* These concern: 
the approach to be taken (ad^ho^ formal) ; centralization/ 

.decentralization; purposes; organizations to participate 

(at least initially) In monitoring* 

The "^re-*dealgn" Issues are discussed below. First, however, 
several observations need to be made* ^ 

1) These Issues are, in effect, RDx system Issues* Decisions 
made on these Issues will be determinative o£ many of 
the specific RDx , monitoring design features* It Is for 
this reason that we "separate them out**^ "pre-deslgn" , 
base decisions.' " 



2) Initial decisions on these Issues must be sensitive to ' 
the more imid and fong term direction that BDx monitoring^ 
might take* For example, if the trltlmate goal is a 
systematic RDx'*wide monitoring process, but an ad hoc 
approach is taken in early stages of development^ care 
must be taken to insure that the result is not a ntusber 
of fragmented laonitorlng processes across different 
organizations which cannot be integrated liater* ' ^ 

3) Precisely becauise these are HDx System issues^ the 
decision process muat^include the full range of RDx 
participants — even if not all will participate in 
the initial* RDx monitoring process — in order to; 



1Q6 



a) tftie RDx monitoring process will realistically reflect 
both the iDonitoring needs of the RDx as a whole and 

f the differing needs and perspectives of the different 
RDx participants; 

b) that all participants will have a stake in the initial 
efforts and the long term development of . RDx monitoring. 



4) Some mechanism must be provided for RDx-wide disctission 
and decision on these base issues* 

5) While we will' discuss each "base decision" i8 a^ |feSepara- 
tely, their interaction on each other must be^rfltoiized. 
(For example, decisions about purposes will affect decisions 
about the approach to be taken; decisions about approach 
will affect what purposes can be achieved.) 

6) As RDx system issues, these issues are, ixi effect , "pre- 
design" issued for each cycle in the development of RDx 
monitoring. However, the discussion below will be 
oriented to the initial development cycle. 

Appl^oach: Ad Hoc or Formal? ^ , 

One of the first base decisions that must be made by RDx is 
the extent t(^ ^ich RDx monitoring will be done on an ad hoc 
and/or formal basis. We have already noted that, at least in 
the initial stages of development » an ad hoc approach has some^ 
distinct advantaf^es : . _ ^ ' 

. flexibility and experimentation, which contributes • to , 
experience and organizational learning 



• *less risk and cost 
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Consideration must also be. given to the disadvantages of an 
ad hoc approach: \ ' 

. potential lack of consistency ^across organizations in type of 
data collected, methods and indicators used, rate of develop- 
ment* 9 

» 

• lack of opportunity for experience and learning regarding 
the interorganizational aspects of monitoring* 

If an ad hoc approach is used in the early stages of RDx 
monitoring, we would suggest the f qllowing as a minimum but 
necessary set of integrat*ive activities: 

. Provide a mechanism to orchestrate th^ development of 
, monitoring across RDx-related organizations; as desired, 
to provide individual organizations with infopnation not so 
easily obtainable ^y the separate organizations; and to 
facilitate experience and learning regarding the inter- 
organizational aspects of KDx monitoring. 

This could be a unit within one of the National Contractors 
which can orchestrate RDx monitoring by providingiigi^danfee 
to individual organizations in the design and operation of 
monitoring, se^prLrfg ^s a clearinghouse^ for solutions* found 
by, the organizations to problems, monitoring the development 
processes in individual organizations, and providing, help 
when needed. 

. Establish a HT t-^innTn core of common or interrelated- monitoring 
activities which are built into the monitoring, processes of 
each organization. 
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. Make 'a tentative decision about* the more long term 

approach to RDx monitoring ^o that Initial RDx monitoring 
designs, policies and strategies can facilitate the' morfe 

'long term development of RDx monitoring • , , 

. , • . ' \ 

If a more formal approach is 'taken, the above three areas 
of concern would become the primary foci for design purposes. 

Purposes of RDx Monitoring 

« 

Monitoring is a "purposeful" activity. Thus, to provide a 
r basis for designing RDx inonltoring, some initial decisions must 
be made concerning which monitoring pulrposes are most critical 
to RDx in ±%s early stages of development. One or more of th^e 
purposes must be chosen a^ a basis for designing RDx monitoring - 
depending in part on decisions whether the initial RDx monitoring 
is to be relatively limited and experimental or more extensive. 
While our> primary concern here is for the initial stages of 
development for RDx monitoring, consideration should be given 
to purpose's which can/should be "incrementally added" over time. 

Participation of RDx-Related Organizations • 

A third base decision which must be made conce'ma^ the issue of 
which RDx- related organizations will/should be" involved in any 
aspect of monitoring (collection, storage, transmission, etc.) 
in the early stages of the development of .RDx monitoring. 
For example:* 

. • Should all Rxs be involved, or should the first "cycle*' of 
the RDx monitoi^ing design involve only two ot three Rxs in 
order to provide some initial experimentation and learning, 
to reduce the initi^ level of risk and cost, and to keep • 
•the- initial RDx monitoring process relatively simple? Are 
all Rxs sufficiently committed to be involved initially? 
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. Should SEAs be involved in the first cycle of the RDx monitoring 
design — or is the risk too great or the commitment too low? 
Which SEAs: all*, a few or only 'those SEAs related to on^ or 
two (but no£ all) Rxs? 

. What^hould be the roles of - NIE aSad the National contractors 
In the early stages of. RDx monitoring? 

Limited participation provides one type of "incremental" strategjr 
which reduces risk and cost, allows experimentation and keeps the , 
initial design relatively simple. At the same time, it also< 
tends to limit the range of experience and insights gained and 
poses a danger of losing the momentum of initial interest aixd 
commitment. 

Centralization A)ec en tralization of Data -Collection 

An ad hoc approach implies a basically decentralized design 
(each organization does its own data collection) — with, of 
course, some mechanism tor orchestration, as discxxssed above. - 
A formal "^approach does not per se Imj^ly centr^ization. None- 
theless^ to the extent that specialization of roles and functions 
is built into a more formal approach, some degree of central-, 
izatiou is implied. The discussion of the overall development 
process suggests that in this early stage qt' development a 
decentralized design process is advantageous. This is not, 
however, a foregone conclusion. 

» 

B. The Design Group 

Obviously, some design group must be establiahed. Here, three i 
.issues are relevant. 

Location , ^ • " 

If a centralized process of RDx monitoring is used, there would 
be a single RDx design group. If, on the other hand, an ad hoc 
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or decentralized RDx monitoring process is used, then each 
participating organization would establish its own design group* 



Form 



If several RDx-related organizations are separately designing 
their own monitoring processes^ their de^ti^ ^roup could be a 
formal unit (which would then^also be respOTisible for building, 
operating and evaluating the monitoring process) , a standing 

.committee, a project task force — or even an individual. These 
groups can be established either as formal tinits within RDx or 
the organizations, or as standing committees or project^ teams 
cuttlng^ across severa^. units. It is preferable to create formal 
units from the perspective *of having a single mission In design, 
and to establish a working unit whose members are committed to 
the design* There are some problems with this, howeyer. 
Creating a new unit 'may meet resistance from the organization, 
especially if particular department heads feel that their depart- 

^ment should be responsible for monitoring. Such a tinit would 
also require creating new administrative roles such as the 
clerical and managerial positions required. In general, each 
organization will have to determine the appropriate "form" 
of l^ts design group. 

Members > 

If a single, ^centralized RDx design group is used, its members 
should include representatives from each of the RDx participant, 
groups (NIE, National Contractors, Rxs , SEAs). If there ate to 
be separate design groups in i/dividual RDx-related organizations 
each organization will need to determine which of its personnel/ 
groups should be represented. 
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C. The Design Process ' ' 

Before discussing the design features, ve can suggest some- 
design process guidelines 

1) Inputs should be sought ^th from relevant administrators 
and from the potential users of nlbnitoring Information in 
order that mojiitoring may. be accepted and 'yield useful 
information* ^ 

2) Milestones and deadlines should be established for each 
step of the design process* Without some targets » die^ 
design processT^ might take a great deal of time to develop* 

3) If monitoring is being designed in separate organizations » 
these milestones should be coordinated across organizations 
to orchestrate desi^ activities and the development of 
RDx monitoring across organizations. 

4) When problems are encotintered by^the design groups in 
different organizalfions , the designers should seek advice 
froni other organizations involved in the design of monitoring* 
This serves two purposes* First, if a problem is encountered 
by on^ organization, it is likely that another has (or will) 
encounter it* Second, it will help maintain a level of consis- 
tancy across designs* 

5) .llie design of monitoring should be compatible with otbe^ 

processes and systems that provide information to policy 
• and decision makers* 



V 
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p: Design Issues and Teatures 

From the earlier conceptual discussion of RDx monitoring, we 
can identify a number of design issues and features which 
should be considered by the design group regardless of 
whether there is a single, centralized RDx design group, or 
there is a design group \7ithin each individual KDx-related 
organization. Th^se design issues and features (discussed 
ielow) are: 



• Determination of needd 

• Indicators 

• Who monitors 

. Timing of information collection 

• Incentives 
. Fail-safes 

, Meta-monitoring 

Evaluation criteria 
Determination of Needs 



A major design issue of RDx monitoring revolves around two. 
Information need questions: 

1) What are the Inf otmation needs for RDx monitpring? > 

2) Which will be included in the RDx monitoring design 
(especially in early images of • developmei^t)? 
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Translation of Pyrpoaea Into Needs 

The above questlona ahould be answered by translating purposes' 
Into the specific information needed about and for specific 
activities of RD»^ and/or RDx-^related organizations. However, 

^ it mus't be recognized that ±n an innnature system such as 
RDx, this is a parti&larly^ difficiat activity. Trans- 

* lating purposes into specif ic^ information needs can at best 
be onJ.y a matter of estimation. Therefore, any determination 
must be treated as tentative, • and a design based on such 
information i\eeds must be carefully examined and evaluated 
' over time to determine if in fact the information needs ' 
identified do*^ realistically apply to specific monitoring 
purposes. 



Analysis * 



The analysis of information needs sThould initially cover ^ 
all the functioSb or activities of RDx and/or RDx-related 
organizations. However, decision^ will have to be made 
as to which Information needs shbuld be included as a basis 
for designing RDx monitpring'. These choice decisions would 
be based on such considerations as relative importance,' 
cost, availability and acussibility of indicators, and th^ 
earlier base decisions about purposes, approach, etc. 

Guidelines . . ' 

While the' actual decisions about informatln needs will be 
specific to any particular situation, some guidelines can 
be suggested to help* in the decision process. 

. Involve potenti^ users of monitoring information 

Potential. users of monit;oring information" shoultl be 
involved in identifying monitoring information needs 
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both In order to develop their commitment to the process 
and because .the design group is not likely to have a 
sxxfficieait understanding of the RDx or RDx-related 
organization to conduct the information needs, analysis 
on its own. ^ At the same time, however, 4:he fiaal 
decisions must be free o|, the specific interests of 
'particular users and reflect an overview of the design 
which only the members of the design group .Will have. 
Thus, final decisions should be made by the deal,0i 
group. . . / ^ ^ 



Limit the range of^ information needs 



V 



To do otherwise would be expensive and (especiAlly in 
the initialldesign) risky. Thus, the various infor- 
mation needs must, in some manner, be ranked in 
' Importance Relative to purposes. 

Information needs may be wrongly specified ;* 

! * - ^ ' 

The^actual utility of any need can, only be determined 
by the operation and use of monitoring. ^T^us certain 
^ ^'guesses" may be nereded and these shodl^d' be made. 
Jxorrecta|cs]/can oncur which will allow a better sfeci- 
"-±4x1^^ 6f-ii6eds in tlje future. 

Identify^the uset of information 



ThilB is" assent i4 for establishing linking tpechanisms 
^to fa^Uts^ the,, transmission of monitoring^ Information 
to tWe^4^Worf m^O^ who need it.^ (In an ad hoc 
approach to- mc^loring this involves only, the decision 
makers ifi"t&e larticular organization.) 




338- 



- 115 - 

f Create an information needr/decision maker index 

This will facilitate the, transmission of information 
^ When it is collected. In a centrally designed, more 
formal monitoring approach, this reqxiirea linking the 
information collected witlbthe participating organiza- 
tions and with decision makers in those organizations 
^ who need the information. * 



Ind icators 

• . - [ 

Ohce a set of information needs is established the next step! 
i^ to identify and select indicators which, when monitored^, 
can provide the needed information. t 

The design group should first estrablish a list of possible 
indicators for each of the information needs. While the identi 
fication of indicators^ will essentially be a proc^ of brain- 
storming by the design group, possible indicators may be 
suggested by^ 

• the types of indicators used by other iiiformation systems^ 
in education and in other kinds of organizations 

• the ideas of other RDx monitoring design groups (if a 
decentralized approach to designing is tised). 

• relevant RDx-related decision^ makers 

Once a list of possible indicators has been established the 
design group can' choose those which are to be used in the 
monitoring design. The number of indicators selected will 
depend primarily on. the "size" of the increment to monitoring 
being designed • 

' ' 339 



The result of this process would provide a documentation . . 
of the process for translating (1) functions and objectives 
(of* RDx^and/or RDx-related organizations) and the tasks or 
activities to be performed into needs for information* and 
(2) these iieeds into the specific indicators chosen for the 
use in^the design. The choice of indicators must be done before 
the rest of the design can be worked out. However, after other 
aspects of the design are created, it may become necessary to 
modify the choice ^of indicators. Therefore, the list of indi- 
cators chosen should be considered only as tentative until the 
initial design is established. 



From our earlier conceptual discussion, we may suggest some 
guidelines for the process of identifying and selecting 
indicators. 

Guidelines for identifying indicators . 

. The initial list of possible indicators should be 
. fairly broad. It is better to "cull the list down" 
later than to overlook pbtentially useful indicators. 

. Indicators* should reflect a specific aspect -of the 
needed information. If indicators are general.^-;^?^ 



refle^ a vide range of information, they are difficult 
to i^trepret and aa are legs useful'. 

Indicators must be accessible. That is, it must be 
possible to actually collect information about a given 
indicator. It is possible to identify indicators which 
wodld.be useful in theory but about which insufficient 
information can be collected. 



Indicators should^be identified in terms of the method- 
ology .and feasibility of their measurement and collection. 



• Several indicators should be identified for each infor- 
mation need. Since any given information need will 
. have several facets > each of these facets should be 
represented by at least one indicator. If possible > 
8evei:al indicators be Identified for each facet so that 
the monitoring process isn^t dependent on a single 
Indicator and/or that a choice among indicators can be 
made. 

.Guidelines for Selecting Indicators to be Used 
. Dnobtrusiveness^^ 



In selecting the indicators to be used, preference 
^ f^hia nld be given to those which can be monitored Jkith-. 
out directly Interferrlng in^the activities of RDx 
and its organizations. Indicators are also preferable 
If they, can bejpro^tected /gainst distortion. 



Information already be;mg collected 

This will help reduce the costs of monitoring, and will 
facilitate the orchestration of monitoring with other 
RDx or organizational activities. ' ' 

Hultlple Indicators ^ 

sThls Vlll reduce fche sensitivity of monitoring to 
error and increase the reliability of the information 
collected. Different Indicators will also provide 
different perspectives for a -given pie*ce of nee4ed 
information, and so wlll t^rovlde fuller, more realistic 
•Informatipn,.* • ' • 



• As simple as possible 

j While complex indicators (i.eT, those wjiich involve 

complicated combinations of {infortnati<m)-^y be necessary 
'for some itiif ormation needs , they^ are bot^ more^ expensive 
and more difficult'' to interpret. 

Timing of Information Collection 

Collecting too much informatifinT (or collecting information too 
.often) in the' Bipnitoring pi^cess can result in waste of 
resources, overloadlng^th thosfe people -collecting; analyzing 
or using information and the channels used to transmit ihfor-^ 
mation, misintrepretation, inappropriate infdrmatiron. and resentr 
ment. 

f * 

Thu8,*1:he design of the monitoring process must ind^e for 
each ^dicator a rule or guideline which specif ied^lwfw often and 
when it is to be collected. In creating these** rules the 
following suggestions can be useful a^rting points • 

An indicator should be monitQ^ed only as frequently 
as needed to identify a^^ange in the process, activity 
or coi^dition it reflects. This is difficult to esta- 
blijsh, jof course, but an\estimate should be made 
based on information about that process, etc. 

. Indicators should generally be collected on a regular 
basis, at specified times. However; is Important . 
that mechanisms be established to trigger monitoring 
of an indicator whenever other inf ormatib^Jn^icates 
that it will be useful to do so. 
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Disiaceatives . . • 

In designing the monitoring process , care must be jtaken to 
remove or neutralize disincentives to cooperation and sharing 
of information* Some basic design strategies could include 
' the follovlng: 



Minimize costs to participants 

This can be aacomplished by keeping the process simple 
in early stages of development, and by adding to«»its 
complexity only slowly.. Also, the desifen should spread 
costs over several participants rather than concentrating 

costs in a few organizations or organizational imits. 

*' 

Insure confidentiality • v - . 

A major disincentive identified abov^ was a fear of 
private or sensitive information becoming public* 
This fear can be diffused by insuring that sensitive 
information cannot>.be directly linked to partictilar 
organizations or units* This requires thfit the design 
group establish criteria for sensitivity, since *8ome 
monitoring information may be less useful if not 
specifically tied tfo a given organization or unit. ' 

Do notr^require major organizational changes of parti- 
cipants ' 

Major organizational changes can be avoided by assigning 
monitoring activities as a natural exten^dh of ^heir 
other RDx activities.- ^ ' ' f " . 
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. Provide participants with equal access to informatioffi 

Unequal access to information can be used to increase 
the pofwer or influence of a given organization or unit 
oveV others. Organization members may fear providing 
information in the monitoring process on- these grounds. 
Therefore, the design of monitoring should insure that 
any organization can atcess information. 



Incentives 

Avoiding or minimizing disincentives is a necessary but n6t a 
sufficient condition for monitoring. Additionally, there must 
be proactive incentives for cooperation and exchanW of inform- 
tion. . 

*• Ik ' ^ 

Incentives ^1^, in some cases be provided through the formal 
reward systons of participating organizations. However, where 
no ^formal reward systems exist (as woiild be essentially the 
case, for a centralized format for RDx monitoring) or where 
eacLsting organizational teward systems are not deemed adequate 
(as may well be the case for a decentralized 'format for RDx 
monitoring) , specific incentives must be built Into the monitoring 
design. 

Fall Safe * * . " 

HDx monitoring involves a number of interdependent activities, 
brganizations and/or organizational units. EDx monitoring 
is a new and relatively uncertain process as is the RDx 
system itself. Under conditions such as these, the potential 
for failure in monitoring is rather large. It Is thus iipor^:ant 

* * 
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to .design RDx monitoring in a "fail safe" form i,e., in * 
such a way that a failure^ in one aspect of monitoring does 
^not /cause the total monitoring process to break cdown and become 
"suspect"-. ' Indeed, such a "total" breakdown in RDx .monitoring 
<wouXd',not only result in. loss of information needed by decisis 
makers ^ it could undermine support for RDx itself. 

. ■ FlexibiUty 

The flexibility to fine tune is an Important fail safe' 
mechanism of this kind. Th^s^ allows problems to, be corrected 
locally Jj^fore their effects are profoundly felt .in -other 
parts" of the process or by users of information. 

• Documentation 

Records of what changes are made in the oionitoring process 
also provide .a fail safe device. By documenting changes 
made tb solve particular problems, these VsolUtions" can 
be used when the same or similar problems appear^ ^galn 
thus cutting down on the chances that such problems will 
persist and affect other aspects of monitoring or other 
organizations/organizational units. ^ ' 

. Redundancy 

A traditional fail safe device is to build redundancy into 
a system at critical points; t;hat is, at places where 
failures are highly probable or where a failure will ^ave 
important affects on the rest of the system. Zn the case 
of the RDjc monitoring process, thla redundancy cpuld ent^dl 
having particular indicators monitored l>y multiple jparticipant 
organizations or by more than one person in a given organi-- 
. zation. It could also incl^uae using' multiple communication 
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channels between organizations; using multiple media for 
transmitting Information among organizations; having infor- 
•laatioA stored In memory^in more than a gingle organization* 
'Thii8> if a failure occurs in a particular aspect of monitoring, 
the information or communication is not lost. 

Such redundancy entails a real cost of course and shoilILd 
t>e limited 'Co the 'most critical" aspects of the monitoring 
process* These can only ^be determined by a careful ex 
tion of any particular monitoring design. 




Criteria for Evaluation of Monitoring 3 

Criteria for the evaluation of ponitoring should -be established^ 
in the design step in order to : 



. avoid disagreement about evaluation criteria during the 

actual process of evaluation ^* 

. avoid having cr'iteria biased by or limited to operational 
perspectives^(though operational experience may later suggest 
new or modified criteria) 



• provide a basis for the selection of appropriate meta- 
monitoring indicators (i.e., for information needed to 
evaluate RDx monitoring) 

In^the early development cycles of RDx monitoring, evaluation 
critjtria should be concerned* with such issues as how well 
the monitoring process is working^ identification of problems; 
major KDx-related changes which require redesign of monitoring 
(e.g., changes in RDx purposes, goals, activities, context)* 
Thdse criteria should be established by the design group (which 
is most familiar with the design). 
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In later development cycles of RDx monitoring evaluation 
criteria will be needed concerning such Issues as monitoring 
outcomes and costs; the value of .monitoring ^informat ion to- 
users. Since these issues^ involve broader issues ^han Just 
monitoring design issues (e.g.; decisions about the continuation 
of' and commitment of resources to monitoring) » these evalxiation 
^ criteria should be established by the design group in collaboration 
with releva^^t administrators. 



^ The follcn^g brief guidelines will be helpful in eatablisliing 
evaluation criteria. 



• Evaluation criteria should realisticaUy reflect th^t which 
is to be evaluated. 

> . Evaluation driteria should be relevant both to the design 
jand to the developmental stage of KDx monitoring. > 

' • Evaluation criteria^, should be measurable, and in establishing 

\ . * ► 

\ a given criterion '1:% procedure for measuring it s^iiould be 
specified. 

i * Inf ormatioiL relevant to each evaluation criterion must be 
♦ obtainable^ } 

Msta-Monitoring 

" .' ' / 

Meta-monltoring provides a basis for short term coo rdina tjbbn 
of short term monitoring activities and of the more long term 
development of monitoring. ^ 

It is essential, then, that meta-monltoring be incorporated in 
the design of monitoring ih the Initial monitoring dtoign. The 
process, of designing meta-monltoring is the same as the design 
of the monitoring process itself. The same decision points, 
issues and guidelines'^are applicable. 
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One additional pofnt, however, should be raised. In deigning 
monitoring in a decentralized, ad hoc approach, meta-monljtoring 
is* needed not only by each organization, but also' by the central 
group or "translator" unit which is serving to orchestrate the , 
separate design and development processes in each organlzaticnv ^ 
This group will require Informatidn on the states of development 
*ln each organization, the problems encountered in each stage of 
development, and the overall effectiveness of the approach 
takfen. Naturally, these same things are needed by the unit 
responsible for RDx wide monitoring. 



E. Criteria for Evaluation of the Monltorinsg Design 

In the process of^signlng monitoring, several criteria should 
be .kept la mind for evaluating and approving the design bfefore.,^ 
it is used to build and operate the monitoring process. 



I 



. The design should Include sufficient* detail to allow it to 
be used to build and operate monitoring 



. The design should be simple in early stages to reduce the 
cost of and risks in building and operatijig inonltorlng. 



. The ^design should be feasible In the sense that the capabilities, 
required can be built in a reasonable period of time, and at 
a reasonable cost. ^ 

. The design should provide sufficient flexibility to allow 
for experimentation with and fine tuning of the monitoring 
process so that organizational learning can occur,, and the 
risks of failure can be.xTeduced. 

. * The design must be ^internally consistent: the procedures ^d 
guidelines specified in the design for the operation of 
monitoring should not conflict with each^ other. ' * ^ 

I 3i8 
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3* Step No>. 2: Building RDx Honl toiling Mechanisms and Capabilities 

The design of the monitoring process (whethfer It be RDx~wide or « * 
specific to d^ferlng RDx-related organizations) serves as a blue- 
print fox actually biilldlng the mechanisms and aapahllltlea needed 
for iDoni):6ring« In this section, then, we discuss spme basic aspects 
of and provide some guidelines for this building process. 

A> A Monitoring Unit 

As specified In the monitoring design, some organizational unit* 
will be needed to supervise monitoring and to provide a trans- 
mission link between decision makers and information collected' 
by monitoring* • In a centralized design this unit woxild conduct 
monitoring activities !^-In a decentralized design it would be 
' more Involved in coordination • 

Depending u^on the design, the activit^s of this unit could 
include:^ the collection, collating/synthesis of Informatloif; 
its temporary storage until it can be transmitted; the* actual 
transmission of information to decision makers; the monitoring 
of the monitoring procefs; and the coordination of the monitoring 
process... In building the tolt, these Activities must be trans- * 
lated into necessary skills; specific^ jobs or positions within 
the imit must be established; personnel pzust be trained or 
hired* 

In creating this unit, it may be useful (at^east initially) to 
bulJLd it arotmd the design grotqi* This group of individuals 
'will have a far better understanding of the monitoring process 
as it is designed, and are most qualified to participate in' 
monitoring and in the building of the ponitorlug unit. 



* 



In its simplest form, this "unit" could, conceivably be a single 
individual or position — though we doubt this will be the case* 



319 



- 126 - 



B» Information Chanitels 

In general, two types of information channels will^e needed: 

1) Between the monitoring unit and the users of information — 
so that information can be transmitted to those decision 
. makers who need it, and so that the users can provide the 
monitoring unit with information on changes in their needs 
and the usefulness of the information they receive (the 
channels required here can be identified by examining 
design specifications about whojieeds eacy type of infor- 
mation) • 

2) If monitoring is decentralized, between the monitoring 

unit and those organisations and/or units within, organiza- 
tions which collect information so that the monitoring ' 
unit can provide direction and receive information. 

.1 

Some guidelines can be suggested for building these channels ^ 

/ 

. Specific Individuals should be identified at either end of 

■ c • 'J > 

of the channel* 

By '^specifying the individuals (or positionsyinvolved^ the 
Information sent over a channel is more liJloBly to be received 
by the individual who needs it. If the communication channels 
are merely between units or work groups, communication is 
less direct* ^ 

♦ The content, or type of information; carried by 'a chaxy^iel 
should ibe specified In advance. 

By limiting the use of * a given channel to particular kinds 
of formal communication, there Is lefts danger of channels 
being overloaded and of information being irr^evant* " 

, ■ ' 350 
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The media used In ^'channel should be specified in advance • 

The pitrticular mediimi used in a Specific channel (e.g. : phone 
calls, taemos, formal reports, face-to-face conror^ation) ^ 
should be specified on the basis of the nature of' Mfomation 
being comntunicated (e.g* : ^ the volnme of a 'given message; the 
need for a record of the message; potential need to clarify 
a message by direct conversation). Naturally,' some c b an n e l B 
may make iise of various media for different kinds of communi- 
cation. ^ ^ , . ^ 

Channels shoxild be formally used only when^ there ±m a 
need to send information. \ 

/ • • ^ . • 

Gen^erally, channe|.s would be formally used wijen new infor- 
mation is obtained from the monitoring of indicators, flow- 
ever, such new information need nof alw^s be sent each time , 
it is collected. 

t 

It is advisable to build in redundancy. 

This is^a ladjor .'fail safe' strategy. The failup of a given 
channel may undermine the entire process . By providing 
alternative channels between individuals or tmits, this 
danger can be reduced. Further, sending the sane message 
over more than one chaimel can reduce the danger; of Infor- 
mation being lost. 



C. The Monitoring-M6morv-Decisio n Maker Linkage 

In order that monitoring- information may be available for future 
use, it is necessary that: 
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organizatlfiiikl memories be buUt Ohe nature' and number 



will depend ilpcn the RDx monltprln^ design) ; 



2. linkage mecha^isms/channelst exist between the monitoring 
units and the Memories (for storage) ; ^ ' 

i r . . ' ^ 

3. linkage me chadisms/ channels e±Lst between the memories 
and decision piakers (fpr access) « 



Storage-an^ access will* require some kind of index and procedt^es, 
but (In a decentralized; approach) the nature of these would be 
determined by the relevknf RDx organization. 



Generally, we would ei^ect that tAe monitoring unH^would be 
responsible both for .scoring information in *and (though no^ 
^necessarily) for accessing information from iqemory.^^ Thusy the 
monitoring unit nQ.t o^ly provides a data-gathering function but. 
also a critical linkage function. 
* . / ^ 



User Education 



It cannot be asdumred t)iat^ RDx monitoring will "fly" simply by. 
being Vdesi^ed an^ built welL — user 'un4er standing- of and 
incentive to us^' RDx monito/ing is also critical* 



For usc^rs to apply^ monitoring, information appropriately and 
realjt&tically to decision* making they must understand: 



the source of information and how it was collected 

i that monitoring is only one source of information — 
\ and that other \ information may be necessary^ ■ 
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• where to get other information ~Jand how it is related 

to monitoring information ^ * . ' * 

* *► 

The education of RDx personnel with .regar'd to monitoring can be 
used in a proactive approach to creating'ltncentlves. Such an 
[Approach would be directed at increasing ^he ^commitment of RDx* 
\participant8 to monitoring, both as uaerg of and as active 
^participants in the monitbring process. This woulrl also se6k to 
establish norms for the exchange of informatioti among RlMe organi- 
zationsf. In effect, this Implies the "marketing" of an RDx y 
monitoring in" the sense of honestly e3q)lainingf and demonstrating: 



the nature,' need and usefulness of monitoring and *the 
sharing at information \ 



^ ' , how monitoring operates 



those* aspects of thk RDx monitoring design which limit 
"^disincentives • " 

those aspects which provide for equality of access 
andJ^ich guard against an organization belti^ placed 
at ^ disadvantage if it shares inf omaticn 



r 



the limits oT monitoring (to, avoid utirealistic e3q)ec- 
^t^tions from monitoring which pan lead to dissatisfaction 
-*and eventual resistance' to the participation in and 

of monitoring) * , ^ ' ^ 

■ ' . . V ■ / . 

the need for dnf onried 'input from users about the moni- , 

toring process* 
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In establishing this program, it will be helpful not to limit 
the participation to the current users of monitoring *lnformation. 
PotSktial users should be identified and included in the program. 

4* Step No. 3: Operating RDx Monitoring 

> 

The building st6p creates the capabilities for the operation of moni- 
toring. Operation, then, is the use of these capabilities to j^erform 
the activities specified ^In the design. -There a^e, however, some * • 
^bay.c issues to bear in mind in the operation step of ^he development 
process. • ^- 

' ' ^ r ■ ^ 

k. Start Up 

It is imperative that monitoring not begin operation until the 
capabilities have been sufficiently built. - If collection of 
information starts before foe monitoring unit has the ability 
to handle incoming. Information (whether it is collected 1^ this 
- unit or not) or before communication' channels have. been established, 
serious overloads may occur which can undermine the entire process. 
Thus, the decision to initiate monitoring activities must be made 
on the basis of an evaluation of the. state of capabilities needed 
for those activities. 



B. Nee^for Flexibility 



In operating the monitdrln^ process, especially 1» early stages of ^ 
development, activities should be conducted with flexibility. 
Sdirce no design will be perfect, those , involved in monitoring 
must be able to make corrections in orders overcome errors in 
the design and' provide a basis for organizational learning. It 
is important,* however, that deviations from the design be documented 
and that the monitoring utllt have a record of such deviations • 
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Further, any deviation should be checked so that adjustments In" 
other activities can be made as needed. 'This is particularly 
'important in a decenftalized pr6c|$s since d'eviatiojis maj^ have 
an effect in different parts ipran organization of RDx. The 
monitoring unit- must take care.^p check on this, and mediate any^ • 
•problems that occur. 

C. Ne ed for Meta-Monitoring "\4 . ^ 

< ' — ' ' 

The meta-jn^^ijjerring process must begin to operate prior to the 
initiation, of monitoring activities. Information on* the .process 
of initiating monitoring will be needed in refining the .initiation 
process in subsequent^ycles of the development of ^monitoring. This 
must delude Information, on problems encountered In making the, 
initial collection and transmissions of monilhoriii^^^^Eoniiation, as 
well as for Evaluating procedures for deciding wh€ 
' building has occurred to initiate monitoring act 

V 

5. Step No> 4; Redesign 

The discussion of the design step has so far focused on the initial 
design of monitoring- There are very few differences between the • ^ 
activities^^ decisions 'in the initial and subsequent designs of 
monitoring, -beyond having a larger base of eSQierience from which to 
\ork. However, some« issues should be raised concerning the nature of 
the redesign.' * - 

A. ^redesign Stage 

Before beginning to redesign the monitoring process, the assump- 
tions and predeaign decisions tised in the prior design must be 
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reviewed and remade based on the experiences and learning * • 

obtained the operation of monitoring, and the evaluation df 
Jzhe design done in the evaluation step. In general, the same 
people should participate isiff^ this pr.edesign stage who P|>a:j^- ^ 
dpdted in the previous predesign activities. Hpwever, exper- ^ \ 
ience may have indicated that other* participants are required. 

The predesign stage in subsequent cycles of 'the development 
process is the appropriate place to initiate changes in^^the/ 
approaches taken towards the long term development of monitoring.- 
It is here that the decision will be made^condeming^ whether the ^, 
RDx monitoring process should lJB<;ome morlB or less formal. The 
progre^ of the development process should also be reviewed and ^ 
decisions made as to .whether it is ^st enough/ The readiness 
of monitoring to be extended into additl|)nal purposes, and tbe * 
nee4 for changes in the purposes of monitoring as a result ^f^ 
the maturation of or changes in RDx can be best deterklned here. 
These decisions and evaluations thus become the basis for esta-* 
blishiJig the purposes, approach and direction to be** taken in the 
.redesign of the monitoring process. • , 

B. Design- Stagfe • ' * 



In the 'design stage in subsequent designs of the monitoring-^ 
process, the same decisions and issues must be addressed that^ 
we discussed in the design section above. However, thes^•mu8t 
be approached in terms of two particular overaU considerations. 

Firsts each of the decisions made in the l^^st desi^ mustS&e^ 
reviewed and evaluated in the light of the eacperien^^ and 
organisational leraning o^^ained during the operation of the ^ 
monitoring ^process,, and' tRl-«valuation of this process. This 
shoiid not be limited to the experience xd-thi^ a^y particular 
organization, even if a decentralized ad hoc approach *has to be 
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t;aken. *-<rhe lexperiences and results obtained in otherXorganiza- 
tions >ls weil^as the solutions to problems encountered ttiould 
^^y^atefen into account. InforroatlJD^ of 4:his kind should be iiade 
Available by the central ' grbi^) created to' overrsee the development 
bf^monitiortng. The guidelines suggested in this paper should 
also be reviewed and^ if necessary, revised. ' ' 



Second > the-design decisions should be revised in terms of any 
changes in the approach taken towards and purposes to be served ^ 
by the monitoring process. 

A 

0 

The redesign should at' least involve the same design group that 
participated in the previous design. If a coo^letely^ new group 
is* used, it is unlikely that a full understanding of the design 
' decisions made 'ptev±ovi3ly will be possible evto if they were well 
documented. Without suoh tmders tanking, much ground will have I 
to be Covered !that was deafLt with in the previous design stage. 
This represents a loss of organizational lea i ai in g and will mean 
that the ne*^ design can^t take advantage 'of the exp'eriences obtained 
in^the previous design. 
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VI. SUMMARY . ; ■ . . , 

1, Purposed of the Paper 

In writing this paper, we have had two major purposes. 

First, the docunient is seen as a basis for helping RDx personnel 
to conceptualize and understand RDx monitoring in its fullest 
sense. This, we feel, is critical since jRp?^ mocdtoring is a com- 
plex process. It includes several organizations and iis comprised 
of a great many interrelated activities which have an impact on 
a wide range of othervjaDx processes. Tliere must be an apprecia- ^ 
tion of thiT^complexity and an understanding of wjiat is involved ^ 
before the monitoring process can^^ be designed and made operational. 

Second ,' i^e have viewed this document as providing a basic guide 
to the design and operation ,of RDx monitoring. By raising spe- 
cific issues and suggesting a way to think about th^se issues, 
we feel that the decisi'6ns about design and operation can be , 
better structured and thus ;nore appropriate. 

We have approached these two purposes by providing a gei^e'ral defi-. 
nition of monitoring which has then been related to the specific 
nature and purposes o^ RDx. Based on this, we have developed a con 
ceptual framework for RDx rndpitoring and raided sevel^al major con- 
siderations about RDx monitoring. Finally, we have, discussed th^ 
desigii, 'operationalization and development over time of an RDx 
monitoring" process. , • * 



2. Maior/Implications • ^ yt^f . ^ ^ 

The , paper has been written in the spirit of providing several ape- 
pif Ic concepts (and a genei;al perspebtive* on^hese concepts) .wjifch 
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can be used by RDx personnel in considering the RDx monitoring 
process « In developing these ideas we have used an implicit 
notion that there are four und^lying concerns about RDx moni-* 



v^oring « 



1) Since monitoring represents a ccmplex Iphenomenon it is 
impprtdnt to^ provide a general way some understanding of 
what it is about: some basic concepts are needed con- 
cerning what it is and what it involves. 

2) This understanding must be translated into more specific 
ideas which can be used as a basis for designing BDx 
monitorixig. Specific activities, .processes ^nd, structures 
must be identified around which |the design decisions can 
be structured by raising a range of issues and questions 
whidh^raust be addressed. * / ^" . 

3) It is also necessary to provide some idWs about how 
monitoring operates . That is, wha€ are" the basic proc^^tes 
and interrelations about which any personnel, whetlux a 
designer or not, need to be, aware to make it work 4^ keep 
it wcnfking. . , 

\ 

4} It is, important to recognize that monitoring, like, any com- ^ 
plex organizational process must be viewed as a develop- '--^ 
mental process which emerges and changes, over time, in 
^ response to natural experimentation; changes^ in the context:/ 
'Changes in the development level of RDx and/or of t^e 8Dx ' _ 
monitoring proce^s-its^lf ; or changes in the purposes' of [ 
RDx or of monitoring. ' 



These four concerns run through the discussion here and in. the sftfin 
boc^e^f the paper.. They represent a fundamental* concept of the 
flAaJon aspects, of any approach toimonitoring, and provide a general 



/ 



conceptual overview for RDx toonitorlng* 



Definition of Monitoring 

:^ . 

Honitoring can be defined in terms of three/basic information*- 
related functions: collection, tr^^mission and linkage* 

Monitoring ct^n be defined as the collection of ibfoz^oation 
about some* system or its environment "which is used in ac- 
complishing some set 'of purposes. The critical idea here 
i/ that, monitoring, in' any specific case, is defined in terms 
of the purposes it serves by providing information to decision ^ 
makers* In thd^case of RDx, monitoring serves many purposes* 
It provides information needed for RDx to operate in a changing 
context; to orchestrate RDx activities; to facilitate organ- > 
iaational learning; to provide a basis for evaluation re- . 
search; to facilitate the interactions among the participants 
in RDx; 'and so on. ^ 

RDx monitoring must, in general, be^ considered as more than the 
colll|rf:ion of information. It may not be possible that indiv- 
idual decision makers or organizations can collect all the in- 
formation that they need. Further, the widis range of purposes 
served by monitoring may require that any given P± ece o f in-, 
formation will be needed by more than one decis^n maker. Thus, 
it may not be an optimal strategy (in terms of the. cost of ^ . 
collection of information- and the availability of informatibn) 
to consider monitoring solely as the collection of information 
by a particular decision maker or organizatipn that upeds it. , 
One should consider the case in which several individuals or 
organizations collect information;>aKxd in which any given or- 
ganization or individual-^ uses information collected by se- 
veral others. ' 

Therefore, monitoring must also be considered' as involving the 

• 360 



- 137 - 

3 • • . ■ 



'.transmission of information, from those \^o collect it to 
, those who need it. Transmission requires that a way exists 
to^ei^fy who needs a given piece of information so that 
it can be spec;Lflcally transmitted «^** without having to trans-* 
mit all information collected to all possible users. This 
implies, as well, that a way exists to allpw the dejfision 
makers within RDx particlpaj^t organizations to ijifluence 
what information is collected, so that the information col- . 
lected is most useful. .These two issues involve what we re- ' 
*fer to as a linking function: linking the collection of in- 
formation to its use. It is analogous to the functions per- 
formed by RDx itself in dissemination and feed forward. 

Thus, monitoring can be seen as being comprised of three 
functions: collection, transmission, and linking. For 
monitoring to be designed and operated effectively, it must 
be understood ^that^ these three functions are all necessary, 
and that they interact: they must be integrated int(^he 
overall monitoring process. ^ ^ ' 

t f 

RDx monitoring provides information about specific aspects of 
RDx itself and the edficational R&D pbntext within which it 
operates. It is analogous to the reading o^ dials or gauges 
^ oh a machine which provides information about critical aspects 
of .that machine* In monitoring these dials are replaced 
by indicators: specific > identifiable, and measureable factors 
which reflect critical aspecta of the process and activities 
in RDx or its environrcnt. The indicators to be used in' 
RDx monitoring must be chosen in terms of« a determination of 
the purposes which monitoring in RDx will serve and those 
aspects of RDx or itai^^^^gontext about which information is 
needed for those purposes. 



^his is'^not meant to imply that RDx, education or educational 
is in any sense machine-like in character. 

' - 3S1 ^ 
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This conceptual definition provides a basis for thinking . 
about the range of activities involved in monitoring anfl 
its purpose in RDx. This is necessary before monitoring can 
be designed and operated. 

* 

B. A Framework for RDx Monitoring^ \^ 

As we have defined it, RDx monitoring is a complex process. 
Information may b^ collected and used by a number of people 
or organizations for a number of purposes. This complexity 
makes it difficult to design and operate monitoring without 
a f rajaework which can be used to" differentiate monitoting 
/activities into categories. Rather than attempting to 
approach monitoring in terms of specific >BCtivities one caa 

(at least as a starting point) think of moAu.oring activities, 
and the interrelationships among them, in nerips of these 
rategorles^ Further, a framework of this type would allow 
one to develop an overview or "map" of RDx monitpring, * which is* 
needed ii^ designing '^xd operating a process as* comjAex as ' 

'RDx monitoring. 

Such a framework can be constructed for RDx monitoring ±»v • 
terms of four dimensions. Each dimension provides a basis 
for differentiating monitoring activities. , 

a. Types of Information ^^ / 

Th6 various purposes which 'migjit be served by RDx 
monitoring reqiiire different types of information. 
^ Thip information can be broken down into five classes:* 

1) the activities being performed in RDx at some 
point in time; 
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2) the activities being performed in the overall 

^ 04. 
educational R&D process at some point in time; 

3) the results of ia)x activities: 

4) the results of educational R&D activities; 

I ' 

« 5) the nature of the interactions among RDx par- 
ticipants, and 'between RDx participants and 
^ organizations in the R&D system. 

i .J . ' 

Monitoring activities" can^e dff ferentiated in tepos of 
the type of information collected; in other words, the 
aspect* of RDx on which a given monitoring activity focuses. 



Time Orientations 



Monitoring activities can also be differentiated on 
the basis of the time frame which underlies the intended 
use of th^ information collected. Current Needs - 
Information refers to that information intended for. tise 
in current, operational RDx activities. Future Needs' 
Information refers to that information required at some 
later point fn time as. an input^to RDx activities and^ 
for more general' activities such as evaluation or policy 
mafc^^n^ which wlj.1 reqtilre historical background as an 
input., ' Future needs information would ^e placed In ' 
•meni^ry until it is needed. ' ' 



c. Location of Collection Activities 

Another way to differentiate monitoring activities is 
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on the basis of where in RDx they are conducted. In 
other words, by which RDx organization (or group of 
organizations) is a particular piece of 4-nfonnation 
collected. 

* d. Location of Needs for Infoinaation 

Monitoring activities can be d^ferentiated in terms 
of where *in RDx a given piece of information is needed 
as an input to decision making — i.e», which organ- 
ization pr group of organizations requires a given 
piece of information as an input to their own activi- 
ties. * 

Taken togetheor, th6se four dimensions allow on6 to specify 
a wide range of categories of monitoring activities. By 
noting- that these four dimensions fully interacB' with each 
other, one can identify the relationships among these ca- 
tegories. This makes, it possible to construct a conceptual 
overview or map of tjie RDbc monitoring process which locates 
what information is colJ.ected, who* could collect it and 
who would need it. \ • 

The design pfocess thus locat^es specific monitoring 
activities within the framework which, given how the 
framework is constructed^ locates them witliln RDx its^. 
When this has been done, one has a blueprint for R&c 
monitoring, this hlueprlnt can be used to 
construct the monitoring process. It identifies those 
participant organizations vhlch; must develop the capa- ^ 
bilities for mopitoring*#Vhere conmmnication channels 
must be developed among K^se-fmrticipanta . it provides a 
mechanism for the linking function. ^ 
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This^lueprint also serves to Kelp RDx participants ' 

operate within the monitoring process. It locates for 

them where information is collected, where they can go 

to get a given piece of informati^ and> if a needed 

piece of information is, no( cur^Hly being collected » 

where in RDx it would be easiest to have it collected 

s 

C. Other Considerations 



The nature of tth& RDx monitioring process raises several other issues. 
'f^^^} issues cfn influence [the effectiveness of monitorltig and its * 
ultiiq^te usefulness to RDXi^^T!heref pre, they should be taken into 
consideration in the design and operation of RD:^ monitoring* 

A major consj^deration concerns when a specific indicator is actually 
mon^bred. It is not the case that dne would monitor all indicators 
£Lt all times* It is iir^ortant to consider how often an indicator— 
is monitored, and under what conditions it ^hould be monitored* 
Some itidicators are relevant only at specific stages of a given 
RDx activity. Others are relevant only in early or later stages 
of the development of RDx itself, CollectlLng information \^en it 
is not directly relevant to some purpose not only results in wasted 
resources hup can provide misleading information ^which results, In 
poor decision makings 

As we have said, RDx monitoring may involve thfi exchange or ' 
sharing of information across organizations* Tijere are several 
potential barriers to this which range from a reluctance to share 
sensitive information about one's own activities to a fear of 
Information being used to<fiStabiish power bases within RDx« A 
system of incentives are needed to overcome these barriers. ' 
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' Such incentives can beXprovided in two related ways. First, 
direct action is neededNfo remove barriers by such me^anistns 
as insuring confidentiality. ' Second, direct incentives can be 
provided by building a highv level of commitment to overall RDx 
goals, and by demonstrating sharing of information is 

necessary for achieving these goals'^. This can be accomplished 
\)y, in| effect, marketing the RD3^^^nitoring process and demon- 
stratiitg^or explaining its in^ortat^e to RDx as a yJkioV^ 

A final consideration concexns the neW to monitor the monitoring 
process itself to insure that mpnitorii^g takes place, 6nd to 
evaluate and redirect monitoring within RDx. This is referred 
to as meta-monitorlng. This^ requires thVt indicators be established 
to provide information about monitoring. The overall monitordl^ng 
framework provides a major input to this, by ^^tif ying those 
monitoring activities which should, be monitored \and * locating where 
they take place. * \ , 

One must address the issue of who should conduct -met a -monitoring »^ 
activities. These activities may.be performed by an}/ participant 
in RDx. It is imporiiant to recognize that if only Ibl dingle ; 
participant or small group o^ participants is involyed, meta-| 
monitoring may be perceived as a threat to other, participants 



/ 
/ 



^^^^ 

D> Development 

In confer ing the RDx monitoring process, it i$ important to^ 
recognize that it cannot be created »in a short time, The ; 
monitoring process mu^t emerge over a sefries of stages in which 
critical design decisions are made and ^implemented, and in w|ilch, 
the skills and interorganiz^tional communication 'channels re^ijuired 
by monitoring can be develop'ed. * 
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Indicators must be suggested and tested at an early stage of' 
development and reffited^ over time. This requires that an 
^extensive analysis be done concerning possible needs for infor- 
mation; Organizations must analyze their existing personnel to 
establj,3h, if .these people have the skills needed for monitoring, / 
They must staff their monitoring activities based on available 

skills or by hiring additional personnel. They must also establish 

» 

organizational units to carry out the range of monitoring activities 
they are to perform. Guidelines must b§ established which can be^^ • 
used by participants in phe development and operation 0^.4^ 
monitoring. These guidelines should .cover the range of issues we 
have discussed above such as. when information should be colTected, 
and who should collect it. While it is possible to suggest tenta- 
tive guidelines^ as we harve in the main paper, these must be 
developed and refined on the basis of the experiences of RDx. 



Conclusion 



The monitoring paper can be used 1^D provide several specific 
reference pALnts in approaching RDxXmouitoring.^ The issues raised 
and the^aiiggestions made can allow one tp begin thinking about 
monitoring inSlts fullest*" sense. By pnwidi^ a basis and direction 
for such thinkings and for discussions amon^Si^dividuals associated ' 
with RDx/ a fundammtal* understanding of the nature^and purpose of 

,BDx monitoring can be achieved. This understanding, taken with 
the more specific concepts in the paper can provide a^ basis for 
structuring the design decisions which must be made for RBx 
monitoring. Thiss understanding and the issues raised are relevant 

/to others in RDx who, although they may no£ patf^ipate in the 
design of RDx monitoring^ will be involved in its operation^ Finally^, 
this understanding and these issues^ are relevant to determining 



monitoring is to develop over time and in response to changing 
ses and needs. This paper cannot serve to provide final 
rs to the issues raised. - This must come from ry^ny sources. 
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We have only attefepted'^ to define the 'domain of protlems and to . > 
* suggest how to idWtify the questions, /ihe final answers must 
take into account the experiences of other systems which ha.v^ done 
fthis, those of members of RDx and u{timalely'the experiences of 
■'BDx itself in a process of ongoing Naming. This requires that 
RDx'take an experimental approach to developing mooaitorlng. This 
paper can be used to determine the questions which need to be 

9 

asked. ^ » ^^ 



i 




368 



^ ' REFERENCES 

Aguilar, Francis, Scanning the Business Environment > New York, 
MacMillan, 1967. ^ . - - 

Ashby, W»-*oss, Design for a Brain , New York, John' Wiley, and Sons, 
1960. . ' ' * 

Bean<, Alden arid Rogers, Everett, "Staging and Phasing Issues in the 
Development of >a Dissemination/Feedforward System in Education", in 
Michael R^drior"^ Durwood Hofler and Robert Rich, eds. Information 
Dissemination and Exchange fox Educational Innovation; Conceptual 
and Implementation Issues of a/Regionally Based Nationwide^ System , 
NIEyionogifaph, Center for the Interdisciplinary Study^ of Science and 
Technology, 1977. 

Burns, Tom and Stalker, G. M. j» Innovation in Organizations , London, 
Tavistock, 1961. 

Duncan, ?lobert B. and Weiss, Andrew 'R. "Organizattonal Learning: 
Implications for Organfzational Design". Advances in Organizational 
Behavior. .Barry M. Staw^and L. L. Cummings, eds. ' Hill'sdale N. J., 
Lawrence Ear Ibaum Associates, in Press. 

Emery, James C, Organizational Planning and Control Systems , New 
York, Macljlllan, I969v 

Guetzkow, Harfald, "Conmunication in Organizations", In Handbook 
of Organizations , James G* March, ed. Chicago, Rand-McNally, 1963. 

Hatcher, Jtean, "Information Capturing Systems", paper presented ^t 
the annual meetings of the Americati^ Institute for Decision Sciences, 
Sai\ Francisco, California*, 1976. 

March, James gI and.Simon, -HerbeVt A. Organizations , New York, 
^ohn Wiley anld Sonsi 1958. 

Michaels^ Donal^, On Planning to Learn and Learning to Plan ,^ San i 
Francisco, Jossey-Bass, 1973. \ 

Majkowski, Charles, "Interorganizational Relations Problems in the 
Design and Implementation of Research and Development Exchange", 
in Michael Radnor,^ Durwood Hofler and Robert Rich eds. Informs 
tion dissemination and Exchange for Educationa l' Innovation; 
Conceptual and Implementation Issues of a Regio nally Based - 
" National System , NIE , monograph , Center for the Interdisciplinary 
Study of Science and Technology. 

Mouzelis, Nicos P., Organization and Bureaucracy , Chicago, 
Aldiner, 1967. 

• ' ! 

Radnor, Michael, Hofler, Duxwood and Rich Robert, Informaticjn 
Dissemination and Exchange for Educational Innovi^tion: Condeptual 
and Implementation Issues of a Regionally Based Nationwide gyste^n. 
NIE monograph. Center for the Interdisciplinary Study of Science 
and Technology. 



- 146 -' 



Rappaport, Alfred. Information for Decision Making , Englewood ^Cliffs, 
N.J. Preptice-Hall, 1970. ' ' . 'J 

Rich) Robert, '^Knowledge Synthesis and Transfer: Conceptual atid 
Practical Problems within the RDx System," In Michael Radnor, 
Durwobd Hofler and Robert Rich eds. Information Dissemination 
and Exchange for Educational Innova|:ion: Conceptual and Imple ** 
mentation Issues- of a Regiona^y Based National sys^terit * NIE 
monpgraph, QeatgF for tjle Interdisciplinary Study of Sciences 
and Te^ci^ao'^^^^^^.^^Y. 



/ 



N 



V 



70 



CHAPTER TEN 



/ 



TIE B5t^' EXCHANGE: 
AN ■E^ERGI^■G EFFORT 



- * ' * March 1978 , . 
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this paper reflect^ the con ti:ibut ions of numerous R5D Exchange participants. 
The initia,! dyaft was* developed by,. an RDx Wor^ group in July 1977 an> has been 
.Revised several titee^s as'e result^of written comments a,nd gr<^up discOssfons. 
Th^s latest version has b^en approte^ by the RDx Execuljive Committee and the 
RDx Advisory Group. ' . , . » * \ \ 



' . • • . JNTRODUCTION • 

The Research-aftd Developmept Exchange (RDx) is an emerging federal effort ' . , 
to bring the worlds of educational research and school' practice closer together. 
It, is operate'd'bv a consortium o^ regional , educational laboratories' and a 
uriive^slty-based\rW center. Acmyities are funded ^through the School ijja<ftlce 
arid Service Division, Disseminatitm and Resources Group, '.National Institute of ' 
fiducation. '* ' j 

• r ' \ 

The purjiose bf the RDx is'reflected in its name: to create an exchange of ^ 
information* Researchers and developers cofaununicate the results of their work 
to educational practitioners. Simultaneously, the practition^s u^e the RDx to 
relay information about their^ needs to j-esearchers, developers, and policymakers. 
Thus* the RDx encourages practitioners to in fluence" future ' r6d policies and programs - 
while it informs them about available? r6d 'outcomes. ^ ^ \ • 

Currently, thV R6D Exchange, consists of four central services and five j:egioiial 
exchanges working through 36 coopex^a-ting state departments of education (see pag<v 12) 

tans aret' underway, hrowever, for the initiatipn of additional regional exch^ges so 
at states not currently involved can ^^participate. ' \ 

' Regional exchanges ope^te in defined regions of the country. Activities are 
carried out pri^iarily through -intermediate linkages affiliated with state departments 
of education. That is, each cooperating state ^^partment has one or moi:e contact 
persons.**^ Local ^ducators,^ then, call oh thes6 linkers when in need of resquf-ces. 
The linkers, irf turn,' r^fcr qifestions or requests as necessa^y,,t;o the regional* 
exchanges^ In some states, ^regional exchanges al3o work with other relcS^ant agencies 
in a similar manner, . » 4 ^ ' . 

-• . * ^ 4 • / 

Supporting ^he jegional^ exchanges' in itheir efforts to serve educational- 
■practitioners ar^four central- services. ' . 

- \ ■ ' ^ ■ ^ . 

The central scwices, regional e'xchanges, and others part^cipating in the K^t 
Exchange are described in the final. sectioh of this paper. 

The^ primary purposeWf the papex, however, is to define the initial"operat ing 
parameters of the R6D Excha'n'g^. ./ft also is intended tol^ facilitate ^discussion among 
^RDx participants, the Natipnal institute of Education (NIE) staff, and others,' and 
will-be revised anc} refined as *discussion and experirence dictates. , 




The papSr touches on a variety of topics of cdntinying concern: the general 
problems toward which the RDx ^ffort ^is directed, understandings affecting, the 
-desigrNo-f the wdr'lc, specific 'problems beings addressed, by the RD/ goals and 
objectives, principles 'Riding the work', a^id example^ of current activities. 



' GENERAL' BROBLEMS 



i^^- ^T^\ ^"'^ ^^^^'^^^ govemment'began to increase significantly 

?S °! 9ducatiohat<L^novations arid improvement and as patt of tSs effort 

developmeivt. In authorizing tJe JkiLna ' ^ 
\r«SJS aSf dS^?2r ^" \V r P"'^"^ ^''^ of educational 

WS sStSJ SSS'" ;i i "^'^^ '^"^^ expectation that NIE .should 

tod^J^S^S/f ^ development responsive to needs of educational practitioners 

'S^neSSk;rtJ;'r!r?f activities to ^sqre that pr^titioners " 
.oenetry£Tam the results of educational research and develojjment. 

xr^caSl%?l^i^J/'^"^''"'^ ^^L^' """"i^d with.O) the extent to which" 
x.eauc^tiohaL r^a outcpmes are,being effectively disseminated and, more importantlv 

• 'Se ifid cZi'w" "e/affecting educational practice; .and (^ti;e"xte;?^ wSl h' 
the^,§d community is jespopdmg to the needs^and problems o^f eWational practice. 

DriiriW "^11^ ^'^""■tio"^! P"«i« see/ms to be affected • 

dCSSnX Si^Lt^'^'- ^ educational'rSd: (1) classrooms. scLls. and school 
J™, / % involved m. specific educational rSd proj^ts;'(2) through 

.fr Snt '"^""^^ networks .-^ teachers ^and administrators le^'^out. adoit' and/ - 
^or adipt cpncepts^nd-nractioss resulting from rSd prbjects; and (3) schools and ' 
rlT'lrotllr'i parch1.r(and adopt'or adapt) mate?iaL which .hai'VKSt I from' ■ 
Smf ^So! MTp/ ''""^ published ^d activel).>aTketed by' commercial • 

So^ffn. - ""^"^ "^y^ ^° i^s"^'^ """i-nal .use of rSd outcpmes 

nterefore. other ways to disseminate and encourage the use of rSd outcomes are be^g. 

the kTnJs recognizes that many factors influence"". ' 

Iht wfr /■ f I J^"*^ development activities-^ now In progress. ..'^These include 
Saci?cf tn^J- '^^""^ of researchers, their experience with educational ^ 
IIK t' y'*^.^"^^^" provided to researchers by their colleagues and institutions • 
and terhaps most lonportartly. the policies and procedures of rSd funding agenc". s 

2ufv if.r^' ^''""^ ^^^-^ ^° which current rsT:; 

2vs oflZ?;^- ^^'''^'i"""! "^^^^f"^-. it is necessary to. explore new 

S^?he at'SLornf °^ educational practitioners .and bringing these needs 

to\the attention of researchers, deve^pers, and funding agencie.s.' 

and Resources f^oun'f ' ''^'^^ acti?itiesr In the fall of 19^6 .the NIE 'Dissemination 
and Resources Group launcfied a collaborative planning effort involving representatives 
from^some educational laboratories, r§d centers,, state educational agfn"es ?nJ" 
mediate agencies, and USOE region&l offices.- the purpose of -the planning effort was 
lexlT%l T/" educational rSd resuLts;to p?actitiopers'(K-?2)'and to 

tiS "^"'^^/"f^'^^tion about practitioners' needs and" concerns to educa- 

"^^f^ers^v.-opers, and their sponsors! TCis effort has.come to.be 
called the Jlesijarctrand Development Exchange (RDx) . 
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DEVELOPING UNDERSTANDINGS" 



In the course of, the planning effort, certain uhderstandings developed regarding 
the nature the educationaT enterprise* These understandings helped define the 
goals^ determine the opjeratirfg prin(5ipl^s, and shapfe the initial activities of the 
RDx*. Figure 1 presents' a filwnewopk §)r discussing some of these understandings,. 



Figure 1 , 
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RSP Outcomes 



On. one side of the figure is the world of educatiqnal practice: those directly 
. involved in the de-^ign and delivery of educational programs arid in the management 
and maintenance of educational institutions. On the. Qchel: side, is educational r§d: ' 
the agencies which /und educational f^, researchers ;9nd -deyel^pers', and outcomes 
of rSd. The two major concerns described in Jhe^firn* section of this'paper are 
, reflected by the two arrov^: ' how best to disseminates" r^ outcomes, tq *educa*tional 
practitioners and how besjc to ''feedforward" informatit^n about 'practitioner needs 
and exp^iences to researchers, developers, and r5d fui>ding'.agcncies,. A wi^e ; 
variety dissemination Qrganizations and individuals afe perfonai-ng activities 
directly or* indirectly r^^ted to tliese two concerns. These groups are represented 
in the center portion of the figure. " ^ ^\ ^ *^ > ^ ' 



The term "dissemination'* and other .key .terms are defined in Appendix A., 
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Educational Practice ' . 

* Educational ptaptice is^ a ^jj^T^a^enterprise which e*ncoinpasses 50 states, 
^ 17,000 school districts, 106,000schoolsv and many* supporting institutions. It 
involves thpusands of professionals who serve millions of students. 'The practi- 
tioners ot particular 'interest to the RDx are "tho.se teachers, .principal's, curri- 
culum supervisors^ district administrator^^ school boards^ and state and^ inter- 
mediate educational agencv personnel ^ho participate in determining the purposes 
of education; designing educational programs and policies, and creating and. • 
maintaining the organizations that fl^liver- those programs and- implement the 
policies, > ' ' ' ) , , 

Pra^itioners a^vp decentraliz'ed to many settings--each of which, whet|ier 
classroom, school, district, or« state dep§rtment--op'erates with a sense of ^ »' • o^* 
autonomyJ £ach s-etting, in part, represent^i distinct interests and needs. Thus , 
^ the pr'^etition^r '^.community is pluralistic, in nature. ^ ' . * 

Ahother characteristic o'f education, due in part to its decentralized, ^ 
'pluralistic nature, is that change^ tends ^to occur individualistically and 
incrementally. Fbr example* changes are ^regularly made in instructional materials, 
in 'instructional methods, in schedules, o'r^ in arganizational arrangements. However^ ^ 
these changes geuerally occur one aet a tim^ they rarely ^re initiated?^ in a compre- 
^^ensive, integrated way. Further^ 'the hew material^ or^processes ar.e, of cotirse, ^ 
Intergrate^ vith existing* available resoul^ces and adaf>te4 to fit user constraints. . - 
. • • V • X . • ' ^* ' ' r 

" Educational R5D " ' ' ' ' ^\ ' 

' * ' Educational rgd is also a complex ^terprise ^onsis^ing of r§d ^undiiig agencies, ' 
/§d producers, ^a^^d r6d. outcdmes them3elves - " . - « ^ 

'. RSD funding ageticjes , Althoughr educational rW work is fiinded. by all levels, ^ " ^ 
of the educational ^y.tem and by the private secto •, the primary sponsor is the 
> federal government. , the government pwn anal\%es', seven major agencies within 

the D^artment of Health, Education, .andMVelfare (DHEW). fund, educatio^l rSd. In j 
^additi^6n, nine^ agencies related to* departments other than DHEW^ are also*involyed in 

funding xfome educational* rSd.* Considering tbe number of bureaus, divisions, ^' - " 
.branches, and progranjs found in this collection of agencies and the variety of ^ ^ 
. r^islatibn authorizing this , work, it is, Veaisoliable^'to assume that the currejit * 
funding of educatiouaL^rfid is dis|^rsed ^d^ is guided by a very. diverse set of ' 
policies andT)rocedu7^es.. ' * . ^ * , \ 

R5D*pfyoducers . R5D producers are a si3bset of a. broader community of individual j," 
' groups and organizations whi'cb ^re involved in efforts to improve educational 
practice. Jn'iEnSory, what distinguishes rSd^producers is thfilj effort tp undersfaro 
educational practice, to build theories and conceptual models based on those under- 
-standings,, to-develop practices based on those theories and models, to subject thoSe 
theori.esV models?^ and pr^Mces to tests, arid %o make revisions in accordance with "^^ 
[ .tesf'rcsult's. R§p producers are found in many 'settings--in school' sys.tenxs, ijiter- ^ 
ine4iitev^seivi<;:fe a^nci^s, state education ag'encies, federal agencfees, universiii^^ 
and coltfeges, rfid centers*, regional labora^^or^es, and a variety of othei> pAva« *\' 
to^TX) rat ions. *. ^ * • * s ,\ . . ^^-^ 



y *National Institute of Education, 1976 Databook:,The Status ^f Education Rfe^earph 

and 'Peyelopmer ^ *" ' • • - - ' 

© 'Office*^! 9 76) ^ 
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RSB dutcomes. For the purposes of this paper >Sd outcomes are defined^s 
'those products, 'skills, programs. instri|nents, teaching and majiag^ent methods 
'and techniques, and concepts that are produced by dispiplined inquiry involving 
activities normally considered part of -the r§d process, such as cohceptualizm^, 
< hypothesizing, 'developing jwdels, field testing, data gathering arid analyzing, ^ 
and evaluating. . , j 

Or.* * * 

- ThelRDx effort is concerned wit"h the following related rSd 'outcomes:. *C1) ' 
the findiVigs qf speoific studies;' (2) concepts, as well, as generalizations • . 

' involving tbose concepts, which structure cuj^t- perception and- summarize , 
current imdet§tanding;. (3) educational practices whijh operational ize current 
understanding, in specific settings, including locally developed rSd-bssed 
practices; and, (4) products arid; processes which help others adopt, adapt, and, 
impleiqent specific rSd-based practices. These-outcomes relate to on* another 
in* the following MSy': concepts and understandings guide the design of studies 
and the development of practices; the finding^- of studies modify current under- 
standings'',, products are derived from developed practices; the use of products 
results in the spread oi specific,practices; and widespread practices provide 

■ .settings for new studies. .Therefore, disseminating r§d outcomes actually involves 

' .dissemindlting a. complex of interrelated outcomes, 

• — ,•• .' * ■ ■ 1 ■ , ' ' ' ' 

, Disseminatjwn, or Linkage, A^t1,viti^ f . ^ " ^ - 

The-.discussion thus, far 'descril4s un^erstandfngs and' assumptions related 'tcx 



> . • The- discussion thus rar aescr^pei uiiyei atanuiiig^j o..- ^^^^...^-^ — -- 

» the two sides of Figure i--the" educational ^actice and the educational rSd , ^ 

• ' cbmmunities. "The functions represented by the'tWo-arrpivs/will now be considered. 
, --thrtUs, disseminatlion of r4d oi^tcomes and /eedfprwai^d^ pf practitioner .needs • 

concepns, and>Mndings^. " .' ■ ' ■ ■ , • 

✓ ' ' / ' • « - I ., ' . : 

N'- ' Disse m.ination of r^d outcomes . Atf preserft, tKere is n^ single, comprehensive^ 

■-system fiir"dis?eminating rSd outcomes to' educational pra;rtitipners and there • 
.•' • . *%ppeai;sjto be a consensus that such a sy^t^ would be yf^desirable. Instead., the 

V . ' , 1977 Di^mina'-t ion Fo. um, attended by individual^ from all levels of the educa^n.l 

^ c6*un4ty;. called for the develo'pmeKt of a- "Nationwide dissemination .configuration^ • 
r (see -Appendix B) , Som< existing elements of this configurat.ion are described 
\ briefly bellow. ' . • ■' " ^ '' ■' •> - ■ * , . 

• •The EducatioparResources information Cente^r CBRIcj -indexes and stores, 
' ^ "\ ' ^ among o.ther,(iocuments',- articles and-reports of research conducted, 

■■' ■\' -unders-tandings developed, rand practices tried. ^ • . ■.. 

• ' i^ny Efforts We underway to/i3entffy. "effeCtWe'* practices, develV^^ 

through-^rSd -activities. For'-wample, the jioinfllissemination "^Review ^ ^ 

• '--Panel fJDRP)*" is identifying such-priorities deVcloped/using federal- 
' non'ies'. The 'National Diffu^I-on Network is then helping practitioners 

- becoriie awar6-of soijie^d^Tth^se practices and consider, them fo^ adoption ^ 
"~ ' .-■ V - ^ and'implementatioii. ,Somp estate, education agencies are developing . •■ 
' ■ '• similar' review ajf\d diffusion' systems . 

* The JDRP is an N IE-USQE panejl which teviews evidence of effectiveness of .educational 
. products' knd practices developed with .federal ,fiAds. -Approval by the panel makes a 
' ' product or prafetice eligi-ble for widespread disS*inination by.NIE or USOE. ^ ^ 
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• •iState education agencies, intermediate services aJgencies , ' and stfme • - 
universities .and large school systems, are developing jesourc^centers 
. and staff capability to help practitioners definfe their information^ ' 
needs, to do information searches for practitioners, and to help 
practJttioner^ to'use the infofn^tion oljtained. ' 

. Special projects (e.g., NIC's RSD utilization proiectsyara exploring " ^ 

V^procedures for helping practitioners with .specific protfieiis- (student ( 
performance in the areas of basic skiUs or career preparation) >vto* ' 
^ ■ consider alternative rW outcomes and select and" "Use tho^e that caii^ i ' 

assist them in solving/ prof) I ems. ' ' - . ' < • 

V ^.''^^SN^^'nples indicate trflat the developing nationwide dissemination 
Configuration includes multiple functions and actors. As such it reflects the 
pluralistic nature of the educational community.it serves. The RDx is one part 
Of this developing configuration with major emphasik on interaction between 
regional laboratories and state education agencies to meet state and regional needs. 

' Feedforward of practiti oner needs- . Currently, the educational practice 
comaunity uses, primarily political means to influence .r5d funding agencies and 
producers... This inflafence takes the fo.rm of a network of intefest gtoups--f6r 
example, ,thS Council of .Chief State School Officers, the government Maison offides 
of unjrversities and colleges, professional" associations ^nd unions, anS, special ■. 
purpose po.ups related to specific government programs ahe CEDaR, mti^ or the'ERIC 
Clearinghouses. Thestf .groups jlregularly present, their'poiiits of, vievT-directty t^ 
the staff of federal agenciesYand tO' the Congress. In addition, jthey seek* to have 
their points of view represented. in agency advisory groups and ,f>»qposal fevi«w' • 
groups. Thus, 4-f there is a system for' "feeding- forward" information about /educa- 
tional practice which influences the work of educational researchers 3nd developers. 
It. IS embodied at least to some degree in^egislative mandates,, agency policies and 
regulations, and requests for proposals of the fedsral governments . . 

. '' - ' ^ ' ' ' 

In addition, some, information regarding the interests and needs of/fedOcaticial 
practitioners ;is provide-i by the r6d commuhity through surveys^ evaluation stucit-s 
and pol*cy analyses. Regional laboratorirt have collected such -information from ' 
\ - ■ stat-es.'to determine regional ffid and service n4eds. However, most analyses of 

edycational, i^eed^ have- tended to. focus on targeted problem areas. Only rarely have ■ 
'the broad, n«#ds of edutation bfeen -assessed*. And there has cfertainly been little ' 
J systemmatic effort to collect or synthesize information about practitioner needs in 
• order to. influence federal r§d priofitiesH • " • 



GOALS 



The understandings about the' nature of the education environment described in 
Pig^n^^lsuggest three concerns that need to l>e addressed: (1) how can understanding 
and useCbr" r5d outcomes be increased in ordej* to better meet practitioner needs; 
, (2) howycan r5d outcomes better reflect practitioner needs, concerns, findings; and 
(3) how can the quality and efficiency of organizations and personnel involved in 
l.iriking r5d outcomes with. practitioner needs by improved? Through its. three major 
goals, the RDx is attempting to respond "^o these concerns. The goals are described 
• below. ' * > 

!• There are increasin^sjiurabers' of organizations and personnel involved in carrying 
out dissemination activities^ aimed at improviilg educational practice. Therefore, a 
major goal of the RDx is: To develop with these organizations and personnel ways of - 
coordinating dissemination activities and resources . , ~, ^ . 

1.1 Share^ Information about alternative dissemination strategies. f 

T ' ' \' 

1.2 ShaVe human 'and material resources \o streiigthen the 'capacity of these 
organizations and personnel to carry out dissemination. 

• 2* There are increasing numbers of r^d outcqpes which can be used in effort^ to * " 

improve educational practice.. Therefore, a second major goal of the 'RDx- is: to 
ilicrfease understanding and use of rSd outcomes by otganizatibns and personnel who 
work. wi th practitioners. ' 4 . 

• ■ V . ' - p « - , ■ - • 

.2.1 Provide consumer-oriented information tha^t ^facilitates comparison of r5d 
outcomes to meet specific needs. , ^ * * 

2^2 Provide' assi'Stance in the use of information abcnit rCd outcomes. ^ 

* Make r§d outcomes more accessible^ . ^» * ' ^ 

3. 'There are diverse organizations and personnel involved in the conduct of r5d S 
to improve educational practice. Therefore, a t|iird major goal of the' RDx is: 
_ To increase shared un4ergtanding and application of information aboutti}ractitioner 
nqeds and ef forts to meet those needs. ' i 7^ 

■ ~ ; .. • ' ■ . • • •) - ' ■ ' ' : ' 

3.1* Provide ^information about practition^s' needs and current activities to / 

help the r5d community make' decisions a^out the production and delivery of ^ 

outcoi^es. " / * 

* , \ 

3.2 ' Provide information about the dissemination and use of Hd' outcdmes, ^ 

3.3 Help the rSd community explore the implicatioiis of information about ^ \ ^ 
V practitioners' needs, and ap})ly this information to their work. 

These goals are concerned with the central portion of Figi^re Tha^ is, they 
are concerned with imjjroving the linkage or disseminatfbn functions of individuals 
and organizations whose primary responsibility is to facilitate a tworWay flow' ! . 
" between the r5d and practice communities\ Such individuals maV also act as. liaisofls ^ \ 
within the dissemination- |bmmunity, They may, of course^ be employed by either the ^' 
rfid or the practice |:omjnunity. Fqj example, suc)^ person could be a dissemilrtation 
spe.cialist fo^ an r^d laboratory or. a staff* development ^pe^cialist for a school ^ ^• 
. district. Marketers?, for commejciarpiiW<shing firms cian aLso serVe this function. 

ERIC . - -.^ 37S - ' ^ 
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^ Operating principles that are used to* guide the RDx in implementing these ^* 
goais are described in the next section. Then, sample activities related to eacft; 
goal are presented. 
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OPERATING PRINCIPLES « • . . ■ 

After arriving at common understandings abput the nature of ^he^ educational , 
enterprise and defining goals based on tljose understandifigsj the RDx^lanning 
group adQpted certain operating principles, to guide its act^ivities. These 
prj.nciples define both what the RDx is and'what it is not. They -are discussed 
below. * ' 

\. The RDx plans and conducts its activities in a collaborative way./ The regional 
exchanges work with cooperating state education ^agencies, and other relevant 
agencies and associations, t<5 define and implement dissemination, feedforward, and* 
linkage activities. The central services work- to support these regiopal efforts to 
meet the needs of state educates. Thus the RDx encourages exchangfes both between 
regional laboratories and state agencies and amang participating r&d institutions ^ 
([labs and centers). It also promotes exchanges among r§d and dissemination staf^ 
within the participating institutions. Thus the RDx attempts to build on existing 
organizations, activities', and functions. ^ 

2. The RDx effort is. developmental . -The need^of educational practitioners ^re 
diverse and changing.. Therefore, RDx contractors, fogether and separately, .do not 
start with fixed .notions of problems? and, potent ia!|^ solutions. Instead, they^work 
through cycles of analyzing currervt-^ituations., defining problems, and designing 
and testing alternative strategies and solutions. Thus the RDx does not advocate 
singular strategies nor doe$ it advocate particular rSd outcomes as solutions. 

3. The RDx is a coordinated effort. That is, -the*regional exchanges and central 
services woi^ together to explore ways of organizing the work to insure qptimum 
use of available resources^ For example, some' information about r5d outcomes is 
best provi^^ through a centralized mechanism. Knowledge synthesis falls in this 
category. lAwcver,. to -meet diverse need? of practitioners, such information is 
disseminated pd used on a decentralized basis. Thus Rbx participants worK 
together to. determine which arrangements^ best meet the criteria of effectiveness 
and efficiency. Thev do not act as separate, independent contractors. 

* * 

due to funding and other resource constraints, the RDX is initially (Concentrating 
its central service efforts on the priority areas of basic skills (Inath and' reading/ 
language arts) and comnctency-based education. These priorities, wei;^ identified a^s * 
areas of need through^egionally cort^ucted assessments. As 'needs change and/or as 
additional resources ^conie available, RDx priorities will, change and expand. Thus* 
the RDx will not become a specialized effort dealing ony with the current prioriti^ 
but will be concerned with a range of r§,d outcome's. ' \ _ 

5. The RQx willwork to ensure equity. ^The contractors will provide for full 
employment opportunities for women and ^minorities an^ will promote social fairness: 
in all^^aB^ activities., ^ . ^ . . ^ ► ' 

* ' o 

* These-^perating principles,* like the RDx goals^, are an outgrowth of the' under- 
standings about the nature of the education environment ^idescribed in Figure 1. Thus^ 
the. understandings, goals, and prindipies together shape. RDx activities. Some 
sample activities are presented in the next section of the paper. ^ 

. • * . • • 



SAMPLE ACTIVITIES 0F R5D EXCHANGE 



KEY: Rx ' = Regional Exchange 

RDIS = 'R§D Interpretation, Service 
RRS =: Resource and Referral Service 
LIS = Linkage Training Service 
SSS = Sy^telJ^ Support Service ? 



Develop with, organisation^ and personnel involved in carrying out dissemi- 
nation ac tivities ways of coordinating disseminatio n activities and resource!. ^ 



• Identify re^iona^ knd extra-regional r§d information s:^stems 
of potential use to state and intermediate linkers.. ^ 

• Obtain and compile conjprehensive, information about resource 
. organisations and personnel in those organizations which 

wilf help regional excfianges, 

• Provide service to regional exchanges in the foTm#f: . ^ 

— Information about available resource organizations and 
personnel in those organizations. • ^ , 

\ y . % ' , ) ' ^ 

Recommendations on suitable i^esources for specif iq.. 

problems^, ' ' ' \ ' 

• . . - \- ^ - 

— Assistance in making contacts .with appropriate organiza- 
tiqpis and personnel . • * 

• Develop and implement a process foV identifying linkag^ 
training and supp^^rt needs. ^ . 

• Identify linka|^^. training, su^'port mseds in-each region. 
•Develop a'conceptual framework for linkage training. 

• Revise and expand "Sourcebook" of lirik\r training materials 

• Produce an inventory of human resources for dissemination 

training and- consultation. 

• , - ^ * ^ * • 

•'DesigT]^and conduct mo4el training programs, to ^eet link^ 
training needs . , , ^ , 

^ ' * i 

• Assist regional exchange u^eri in th^e analysis or evaluation 
.^of existing dissemination programs and activities 

^ I * * 

•= Assist Tfegional exchange users in c'onjlucting their own needs 
assessments and in examining alternative models and 
strategies 'for decision ma^cin^^by SEAs, ISAs,' and LEAs-/ ^ . 



ALl Rxs^ 



RRS 



RRS 



\ 



LTS 

All Rxs 
LTS 

Lts^ 
LTS ; 

LTS; Ail Rxs 



SSDL, AEt, 
,CEMREL, § NV/REL 
Rxs 



SEDL, AEL, § 
NWREL Rxs 



■• ( 
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Goal 2 ; 
i^er Sonne] 



Increase understanding and use of rScT outcorltes by org^i;;;ations and 
1 who work with jjract itioners, ] ] / 



• Identify materials and information systems whi,ch provide 
information on alternative educational programs and product' 

• Develop model products which pull together information on 
r§d outcomes and product alternatives in RDx priority a^eas. 

• Collect and prepare selected rgd cdnsujner information 
materials to meet high priority noeds of regional users. ^ 

. .X ■ ' ■ " • 

• Distribute consumer information materials to personnel with 

I dissemination functions within the region through mailings ^ 
' and regular personal visits both proactiveiy and in response 
to- individual requests. 

• Identify products described in NIE Catyog which are 'not 
available. . * . \ ^ ^ v 

\ 

• Establisfi, and maintain a small-scale regional collectiw.bf 
rSd products in RDx priority areas, '* { .'"^ 



RDIS, RRS 
RDIS, SSS 
All Rxs 
All Bxs ' 

SSS* 



AEL 5 NWREL 
Rxs 



Gqal 3 : Increase shared onderstanding and application of .information about 
practitioner needs among organizations and pefsonncl in\/blved in the conduct of 
educational r^d . 

Develop conceptual frSmework, and ^Srgn,-^ inclement " ^ SSS . 
procedures for collecting and agg;fegati?f^''information about 
practitioner needs, 



•.Collect d^ta on regional educational needs idertified by SEAs 
from statewide needs assessments or information requests* from 
state, intermediate, and local linkers, ^ 

• Syntl^size data on regioi;>al educational njeeds, and report to 
the, Systefj Support Servicfe, NIE, and other relevant groups,' 




reco 



yntWsize regional data from various regional exchanges' ai^d 
mS^^d priorities for RDx, " ^. * ^ 

ect information about the extent of use,, and the 
i>ility of, r5d (products in the region and forward to the 
•System Supparr Service. * , * 



All Rx: 



'All Rxs* 

. ^ r 



SSS 



*aeDL 5 AEL 
Rxs 



ERLC 
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^(^•Dev.elop a- r5d»prt)duct tracking system and maintain a system- 
wide file of information concerning NIE and non-NlE r5d 
, outcomes in high priority problem areas. 
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STRUCTURE AND FUNDING OF THE R§D EXCHANGE 



1*2 



age'cr'^^' '^"'^''^^ ^"^i-^y ^roupf"Ld Se 'funding 



R^^Lnff b5 . • ,^«^8i"g regional exchanges .include thi ^^id-cpntinent 



-1^ 





Appal a<:hia Educational Laborator y 
Charleston, Wes^ Virginid V 

" Alabama 
Florida 
Kentucky 
Mississippi 
^ Ndrth Carol ina , , : 
South Carolina / V* 
. Tennessee * m!: ; 

Virginia ; . ^ 
West Virginia 



CEMREL,. Inc ! ' . ' I 

St« Louis, Missouri / 
ith Mrd-contincnt. Regional (Educational 
aboratory, Kansas City, MissburJ. ' 



IWinois 
Indiana 
Iowa 
Kansas 
Mjchigan* 
Minnesota 
Missouri 
Nebraska 
Ohio<> 
WisconisiiT 



Northwest Regional Educational L aboratory * 
Portlajitf,. Oregon ^ \ 



Alasica 
Colorado 
Hawa i i 
Idaho 
Montana 
Oregon^ 
Utah / 
Washington 



Research for .Better Schools. Inc . 
Philadelphia, Pennsylvania' ^ • ' 

Delaware / 

Maryland , . , > 

New Jcrsejj^ ^ 

Penn^lvai^a 



Southwest Educational Development L abor itor^' 
Austin, .Texas 7 ~^ \ 

': Arkansas . , ' - . 

Louis-iana / • ^ 

New Mexico . ' . 

Oklahoma * * . 
Texas ' ' 
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AEL Rx 



Advisory 
Board 




Regional 



4 



System 
Support I. 
*16rvice 
I.FWL) . 
(Ex, SecO 



SEDL Rx 



Advisory- 
Board 



^ -'y^ > 

I SWRL Rx 



I 



I Advisory ' 
LB^rd J 



Qentfal 



ResojK.Pfes 5 
Referral ^ 
Servi-ce 

(CVE); 



Figure 2 

R S D Exchange Operational Chart 



NWREL Rx 

— 
Advisory 
Board 



Exchanges 



Midwest Rx 
(CEMrtBL) 



Advisory 
Board 



iMcRfL Rx ( 
J_Ad visqry_Boa^ i 



Support Services 




RDx 
Executive 
Committee 



Nation^ 
Institute of 



Education 



Linkage /. 
Training 
Service 
(NWREL) 



■j 



R § P ^ ' 
Interpfetatioh 
Service 
(CEMREL) • 
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Central Services " 

Four central services support the regional exchanges in their efforts to serve 
state edlicators. The services are described below. 

• • A Linkage. Training Service provides training, consultation on training, 
and oth.er related support for individuals responsible jFor dissemination 
activities in thefr state, service area, or scliool' district . This 
suppo-rt is provided hy the Northwest Regional Educatli^nal- Laboratory.' 

• An R5D Interpretations Service is experimenting with transforming r5d- 
based ^knowledge, initially in the basic skills areas, into forms that 
can be used more readily by educational practitioners. This includes 

'identifying existing interpretive literature. The intent is to provide 
information that will help educators make choices among an array of 
materials and practices. This service is provided by CEMREL, Inc^. 

• A Resource and Referral Ser.vice is building a databank of available 
informatiah' resources. Included will be data about organizations and 
people' who produce, are knowledgeable about, or disseminate f^d outcc>ffies^ 
in the basic skills and competency-based education areas.. This service 
is located at the Center for Vocational Education, Ohio State University. 

^ •>A System Support Service facilitates the operation of the total R5D 

Exchange, including coordinating the effo3?ts to inform the r§d community / 
of practitioners* reactions and needs. This service is provided by the 
Far West Laboratory for Educational Research and Development, San . 
Francisco. ^ 



Additional Activities 



In addition to performing the types of activities already, described, the RFx 
contractors, together viitA NIE, have additional m.-r:cLgement and coordination 
responsibilities. Some of these are carried out by individual contractors* working 
with NIE monitors, while others are coordinated through the RDx Executive Committee 
which includes a representative from eaq h contractor. The functions of the_ c 
Executive Commfttee are defined' in a separate. paper that is available upon request] 
Likewise, a separate pape'r defines the functions of the Advisory Group, which meats 
two or three times a year to provide the RDx with advice on policies and priorities. 



RDx Funding 



The R5D Exchange ir. funded by the National Institute of Education with monies 
which come from the part of the NIE budget allocated for the sole support of 
regional/ educational laboratories and University-based r5d centers. 

^^Current RDx contractors were chosen as the result of k competition.' The 
initial pl^anning period ran from October 1976 through February 1977, 'Planning 
continued during the subsequent nine months, Mar^h through November 1977. > During . 
this time feasibility testing of activities^ was also conducted. ^ The current 
funding period extends through May 1978. After that, R5D Exchange activities will 
be included as part of the overall, institutional scopes-Qf-work of laboratories ^ 
and centers, ' 
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APPENDIX A 
KEY .TERMS 

Consumer i-nfonpation : analystic, interpretive information on multiple T5d basedN outcomes 
such as EPIE product reports,, interpretations of research findings for teachers;, etc. 

Dissemination ^ , A ^knowledge-transfer process' which may consist of four levels of activities:^ 

. Level 1. Spread : *rhe one-way casting otit of knowledge in all its. forms: information, 
V products, ideas, and material^, *"as though sowing seeds." 

s. 

Level 2 Exchange : The two-way or multi-way flow of information, products, ideas, 
\^ and materials q^s to needs, problems, aij^ potential, solutions. 

Level 3 Choice: The facilitation ^oT^tionaljionsideration and selection among those 
ideas, materials and outcomes of 'research and development, effective educa- 
tional practices and other knowledge that c&n be used for the improvement of 
education. ^ * 

Level 4 Implementation : the facilitation of adoption, installation, and the ongoing 
utilization of improvements. 

'Exemplary Practice : A new or outstanding practice developed in a local eduction setting. 
A practice is exemplary to the degree it meets five criteria: (1) is viewed by practi- 
tioners as needed and worth initiating; (2) is succ'essful/effective; (3) is exportable; ^ 
(4) is Teasonable in cost, time, and personnel required for implementation; and (5) has^ 
been systematically documented. . ^ - 

Feedfo^-ra.rd : the process of domnunicatlng educational practitioner (and linker) need^s for, 
. ^or reactions to, r5d outcomes to" the r5d community (sponsors, performers, trainers, 'etc.} 
with the intent of eiti ^r (a) influencing the chstracter ind responsiveness of futile r§'d, 
activity (including picduction and delivery) ,or (b) of providing evidence regardi.:g the 
impact on or benefit^of current and past r§d activity. 

Feedforward activity : activities such as data collection, ^ata synthesis and. data reporting 
that focus on channeling user needs and user experiences with r5d outcomes to knowledge 
producers and educational decision-makers. 

Knowledge transformation/analytical and interpretative product ; a process of translacing/ 
interpreting r5d outcomes in tdrms of essential practices^ and conditions that can lead 
to replication and/or adaptation by practitioners. The tdfawing of implications for 
'practitioners is embedded in the definition. ^ ^ 

Linkage^ the establishing and maintenance of effective channels of communication between 
practitioners in schools and various knowledge-producing* agencies. ' 

* * * . * ■* 

Linkage system : the agencies--such as universities, publishers, RIEs, State Departments, 
intermediate service agencies, tEAs— who collaborate to prqvide la link between the" 
* practitioner and r§d products. I , • 

♦Adopted from the Report of the Disseninatiofi*^Analysis Group to the Dissemination Policy 
Council, Office of the Assistant Secretary for , Education* "HEW. 

FR?r see 



Linkage support system ; agencies— such as labs, centers, regional exchanges— whicl^ provide 
consultation, training, and the accessing of, huiaan and material r^soyrc^s to facilitate 
the .operation of the linkage system. 

. • ' ' ^ 

Linking agents or linkers : individuals who help others engage in* problem-solving by 

connecting them with appropriate knowledge,' materials, .and human resources ^and who help 
' them in the use of these resources. * , 

R5D outcome : the result of the rod process. It may a product, a model, a policy "finding,, 
•or a research result. What sets rSd' outcomes apart from other knowledge is that they^are 
tested in the field on the relevajit population and then adjusted accordii^gly 

' / . ^ ' ^ - ; ' 

RSD product : a tangible^ transportable, sel-f^contained outcome of the process. The r§d 
process involves a sequence of activities rooted in the scientific method in which 
research findings or relevant theory is translated into usable artifacts. The 
translation is then subject to evaluation and revision to ensure that the product(s) 
meets the needs* for which it was designed. 

RSD resource : resources are of two types: materials and human. Material resources include 
organizations and information products . Human resources include personnel who produce, 
are knowledgeable about, or disseminate rSd outcomes which would J)e useful to the RDx.. 
Both material and hjuiian resources reflect the approach of systematic, disciplined inquir<^ 
to educational 'i3rob*l em-solving. *\ ' . ' 

RSp tracking : the process of detenrdning patterns and- locati&ns of rW outcome utilization*" 
and impact within the educational community. 

Technical assir>ta nce: provision of support tcf* participant groups for 4:he purposes of 
solving problems in planning, implementa^tion and evaluation of dissemination plans^-of 
providing or brokering training in dissemination skills, of providing access to informa- 
, tion about r§d outcomes and resourtes. 

T Mn-market material s : rS^d products, programs or pract/ces that are designed for a small 
^ yet specific, segment of che educational community, v^ich are unsuited to a mass-markei 
commercial distribution, and expensive to install and/or maintain on a per-student basis. 
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• APPENDIX B 

\^ ^ . . " 

^\ STATEMENT OF AGREEMENT BY PROFESSIONALS 

IN TOE ^FIELD OF EDUCATIONAL DISSEMINATION ^ 
AT THE JUNE 1977 DISSEMINATION FORUM 

/ 

Continuous efforts are required to raai;itain and improve educational practice 
so that all Americans have the opportunity to learn in accordance with their need. 
Research, development^^valuation, and dissemination of effective practice are 
vital to the achievement*>f^^his> goal . ^ 

^ At the cux:rent time a number of agencies, ^^r^anizations, programs, and systems 
ai^working in ttte area of disseminati<in . These existing efforts arc making signi- 
ficOTt^eadway in providing support for educational improvement and should be 
encouraged to continued ^ ' ' ' 

At the same time it is believed that the results^ of these .efforts will be 
significantly imp^qved if they can be incorporated into a^ationwid<it^Dissemination 
Configutatio;!.* The^ development of sucji a configuration can Ijelp to alleviate the 
problems identified by^V^ent analyses and assist, the Office o^ E^ucata^on, the 
National Institute of Educat;ion, and other ^l§ments in the EducatiOn^Division of 
HEW, in meeting congressional m|nda(tes related \<i^dissemihation. ' 



The deliberate development of such a natioijwide configuratipn, over time, ^an ^ 
also help educators better understand the array Of resources available to help them 
improve the educational system. The undertaking of su^h, a Vlatiomvidc effort is 
important; no single agency or group of agencies could or should^evelop a national- 
i^d system nor could they acquire and manage all^he necessary resources. * 

TCr^^omote the development of such a NatiamiRNde dissemination Configui'ation, a 
group of professionals** woAing in the area ot dir.semina>^loh met in Arlington, 
Virginia, fai;;^ one^ecV in June 1977. They adopted the following statement of agree 
ments^ as a means of">K^iding a common base for al J th^se who would undertake the 
development of the^ Natiotm^de Dissemination Configuration. (The reiQorded vote for 
^adoptioYi^as 191 yes, 4 no/^^not voting.) 



X 



*The^word conf igur^jii o n was chosen to coincide with Cuba ajid ClarK's use of the term 
in their paper, cited' l^elow. The word system was rejected; a*s connoting cJentral 
control, and network was rejected because of possibly cpnfusion, with th6 National 
Diffusion Network. Egon G. Cuba and David^., Clark, The Configuration ^Perspective : 
^View of Educational Knowledge Production atK^ Utilization ? Qj/ash in g ton, D.C. : ^\ 
Coiin^l for E*ducational Development and ResearcltvNovember 1974)\ 

J^Participajvt groups included representatives from: El^lC'dl^atinghoujse personnel 
arJd^scrs; e^^aIuation contractors for major di ssemi,nation p^o^ams in OE and NIE; 
National Diffus^oi^Nctwork facilitators and developer/d>^mOns*trator§; National 
Institufce'of Educations-Office of the.IUrcctor and Dis^scminati^ and Resources 
Group; Offi<^ of the Assistant Secretary for Education jr QJff ice, of Education--all • 
^ major bureaus x^nd regional offices; Rese'arch and Developmbnt^sfexcjiahge contractors" 
— selected laboratories and centers; 'Research and Development Utilization contractors 
State dissemination reprcsentatives-^Natidnal Dissemination Le^cfcrship Project.' No* 
official endorsement from any of these groups> should be linffexred, however. 
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Agreement 1 : The pirrposes anil outcomes of dissemination activities are 
many, ranging from acquiring knovAedge for its own sake to specific improvements 
in educational practice. Although the ad^option of innovations and chahges in 
practice are possible outcomes, dissemination activities can also lead -to 
decisions to maintain existing practices rather, than to change. 

.Agreement 2 : A number of efforts have been made to define the word 
dissemination . These efforts make it^clear that several meanings are possible 
when the word is used. The Dissemination Analysis Group (DAG), a joint government 
task force, had delineated four possible usages: 

Usage 1 Spread : The one-vray casting out of knowledge in all its forms--inf orma- 
tion, products, ideas and materials--"as though sowing seeds." 

^'sage 2 Exeh^ge : The two-way or multiway flow of ihformatl^on, products/ ideas, 
, and materials as to needs, problems, and potential solutions. 

Usage 3 ^Choice : The facilitation of rational consideration and selection among 
^ those ideas, materials, outcomes o!f research and development, effective 
educational practices, and other kjiowledge that can be used for the ' 
improvement of education. ' , - ^ 

Usa^e 4 Implementation : The facilitation of adoption, adaptation, and installation 
of improvements. 

It is recommended tha.t future usage make clear which, if not all, are denoted. 

Agreement 5 : The development of a Nationwide Dissemination Configuration can 
enhance improvements in educational practice. Such a configuration should be open, 
nonprescripti\c, and multipurpose. It should be influenced by all levels of 
government and by other groups and individuals, and not dominated by any one. 

Agreement 4 : An effective Nationwide Dissemination Configuration will require 
a broad, fnWg^ated 'resci "ce base of knowledge, 'a 'ormation about educational 
research and development, practices, policies, and legal matters should all be <i\^aiL 
able through an ERIC- compatible index and a universlilly available set of.'access 
systems. These resources should be base4 on the current ERIC system, enlarged to ' * 
encompass the respurces of other eductional infoiv^ation systems and clearinghouses, . 
as well as the addition of new types* of. data files" as appropriate. Quality control 
of resources should be'vmaintained. Adequate information s^hould be provided so that 
the users 'may judge and\valuatf these resources for their own purposes. 

^ Agreement 5 : Resoa^f^.es should be accessible to and supported by a variety of 
means and styles of linkage: , • * ^ 

a. Continuous effo?-ts to organize and transform the knowledge base into 
language, format, and styles suitable to a variety ojf different audiences' 
should be ^naintrained. Particular attention should be' paid to the needs ^ 
of educators, laypersons, policymakers, and especially -those individuals 
that traditionally have. not 'had access to the knowledge base; * 

b. Human assistance in searching, interpreting, and supporting the use 
of the kno\;ledge base should be given by providing services that are 
accessible to users, provide rapid assistance , i and arenas objective as 
possible. , ' *v ' 
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c. Human^ technical^ and financial assistance in implementing knowledge ^ 

that promises to improve educational efforts $hould be available,^ » 
particularly to decisionmaking groups within educational institutions. 

This assistance should include: ^ ' 

• technical assistance in implementing specific inriovat^'ons, 
practices, or products that meet the requirements of users; 

t assistance to educational institutions to insure that they gain 
the capability to use knowledge effectively; 

' * • t assistance to lay persons and citizen groups that will provide 

them with the increased capability to influence educational practice; 

• encouragement to tho6e who risk changes in the status quo to under- 
take activities they believe will improve education. 

The styles- by which such linkage services are available sKbuld be broad and non- 
prescriptive, . * * * * \ y, ^ 

Agreement 6 : Dissemination, including the Nationwide Dissemination fonfigura- 
tion, should be an ol?ject of study, and improvement in. its ovoi. jight. . 1. 

a. Information about the configuration should be developed and communicated- 
to insure an informed, public process 'for coordinating the configuration. . 
Particular emphasis should be placed on the development, of information . . 
about user needs avid requirements- -both in temjs t>f new knowledge that 
should be created ftljrough research and development and in terras of services 
needed from the configuration. ^ ^* . s ^ 

b: Specific tools, training programs, and other support efforts should be 
developed to insure the e'ffective strengthening and growth of the 
configuration. ' f 

- c. Research, ana de>4elopment on alternative luodels, theories, and practices 
of dissemination should be carried out and shared systeTnatically. 

AgreeiPtnt?: Sinie the components of the configuration arc now,s'aild perhaps^ , 
always will be, developing, there may be no. absolute roles for various agencies, 
'groups, and individuals.^ In g^ii^l / however, the configjiration should be initiated 
, with these assumptions about functions that should be p4f formed at various levels. 



a. A national J evel 'function should be to 



• develop a community of interest that will establish goals for the 
configuration; . ' . , , 

f operate those elements that serve nationwide needs; 

• provide incentives for a variety of institutions to build their own 
capacity to operate the configuration within their spheres of activity; 

• support research and development on the configuration. ' 



. b, A state-level vfunction should be to provide Jeadership in defining 
staxewi4e dissemination systems uWique to the requirements of each ' 
»state* l^e auton9my of states mixdt be carefully preserved, consistent 
with thfeir constitutional and leg^l responsibilities, ^ 

Agencies engaged 'in direct i nfetruction and those they serve should 
be the primary beneficiaries of the configuration. The function of the 
configuration should be to serve /their needs with a minimum of constraint 
upon them* The configuration shduld not promote change needlessly;^ ^' 
instead, it should support efforts to maintain an environment in wjilch. 
students of ail ages c^n learn. /The confi^ration should recognize' the * 
contribution that educators make/ as a source of exemplary practices and 
information about the effectiverJess of other innpvations. The autonomy 
of these agencies and *their T)oai|ds should be respected. - 

d. Educational laboratories, research centers, universities and colleges, 
professional associations, independent institutions, individual scholars, 
and professionals should be encoiiraged' to share and provide their know- 
ledge and- services through the bonfiguration and to participate in its 
'Stuciy^nd management. They shobld be encouraged to build their capability 
to extend the configuration as Well as to provide technical assist^ce to 
- it. f ' . ' 



e. It is recognized that the t 
agencies are complementary wit} 



activities of public and tax-supported 

w ^ , ^ th^ activities of the priyate sector. >^ 

Functidns not adequate!^ provi(|c-d by the private sector can be under^takenN 
by public and tax-supported agencies in a way that enct>uragcs the private 
sector to be involved t6 the fullest .extend possible. , 

4 i ^ . * . ' ^ > 

Agreement 8 : Support for*such a configuration must be cooperatively shared ^ 
by all participants and benefici&ries .. The. development of* this configuration' wil] 
require the expenditure of both fiscal and human energy, these resouiXes are 
obtainable only thro^^^'.h efforts th^at focus on coop* rative and accommodating 
relationships among o,,rticipants ')for the rtiy)tual b3i.efit of all. 

t . . . ' »• 

Agreement 9 : iThe long-term vitality of the National Dissemination Configuration 
is dependent not only on more effective utilizafiLon of existing. Jcnowledge and 
rfe^ources but also on the continu*edi support for^pp'ropriate research and development 
so as^^ renew the knowledge base. , ' ' 
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